-- Logs begin at Thu 2022-07-21 08:28:21 UTC, end at Thu 2022-07-21 09:43:03 UTC. -- Jul 21 09:02:19.511176 dv-cinder-826608-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 09:02:19.520752 dv-cinder-826608-6-smb devstack@keystone.service[80450]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 09:02:19 2022] *** Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: nodename: dv-cinder-826608-6-smb Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: machine: x86_64 Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: clock source: unix Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: pcre jit disabled Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: detected number of CPU cores: 4 Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: current working directory: / Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: detected binary path: /usr/bin/uwsgi-core Jul 21 09:02:19.522805 dv-cinder-826608-6-smb devstack@keystone.service[80450]: your processes number limit is 47680 Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: your memory page size is 4096 bytes Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: detected max file descriptor number: 2048 Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: lock engine: pthread robust mutexes Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: thunder lock: enabled Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 09:02:19.530746 dv-cinder-826608-6-smb devstack@keystone.service[80450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 09:02:19.567591 dv-cinder-826608-6-smb devstack@keystone.service[80450]: Python main interpreter initialized at 0x555e19bb19c0 Jul 21 09:02:19.567591 dv-cinder-826608-6-smb devstack@keystone.service[80450]: python threads support enabled Jul 21 09:02:19.567591 dv-cinder-826608-6-smb devstack@keystone.service[80450]: your server socket listen backlog is limited to 100 connections Jul 21 09:02:19.567591 dv-cinder-826608-6-smb devstack@keystone.service[80450]: your mercy for graceful operations on workers is 90 seconds Jul 21 09:02:19.567931 dv-cinder-826608-6-smb devstack@keystone.service[80450]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 09:02:19.568029 dv-cinder-826608-6-smb devstack@keystone.service[80450]: *** Operational MODE: preforking *** Jul 21 09:02:19.568313 dv-cinder-826608-6-smb devstack@keystone.service[80450]: *** uWSGI is running in multiple interpreter mode *** Jul 21 09:02:19.568313 dv-cinder-826608-6-smb devstack@keystone.service[80450]: spawned uWSGI master process (pid: 80450) Jul 21 09:02:19.568526 dv-cinder-826608-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 09:02:19.573677 dv-cinder-826608-6-smb devstack@keystone.service[80450]: spawned uWSGI worker 1 (pid: 80463, cores: 1) Jul 21 09:02:19.573677 dv-cinder-826608-6-smb devstack@keystone.service[80450]: spawned uWSGI worker 2 (pid: 80464, cores: 1) Jul 21 09:02:19.573677 dv-cinder-826608-6-smb devstack@keystone.service[80450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 09:02:25.034397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:02:25.034397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: from cryptography.utils import int_from_bytes Jul 21 09:02:25.035216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:02:25.035216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: from cryptography.utils import int_from_bytes Jul 21 09:02:25.037235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:02:25.037235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: from cryptography.utils import int_from_bytes Jul 21 09:02:25.037727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 09:02:25.037727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: from cryptography.utils import int_from_bytes Jul 21 09:02:25.085340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 09:02:25.085527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 09:02:25.085639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 09:02:25.085719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 09:02:25.085814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] command line args: [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 09:02:25.086042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] command line args: [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 09:02:25.086173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 09:02:25.086331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ================================================================================ {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 09:02:25.086452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 09:02:25.086606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] admin_token = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.086755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ================================================================================ {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 09:02:25.086930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] config_dir = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] admin_token = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] config_source = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] config_dir = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] debug = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.087937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] config_source = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] debug = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.088934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_config_append = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_config_append = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.089898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_dir = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_dir = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_file = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_file = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.090955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.091893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.092989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.093104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.093218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.093336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.093456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.093874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] publish_errors = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.094979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] publish_errors = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] standard_threads = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.095953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] standard_threads = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] use_journal = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] use_json = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.096879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] use_stderr = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] use_syslog = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] use_journal = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] use_json = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.097949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.098070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] use_stderr = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.098197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.098313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] use_syslog = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.098426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.098547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 09:02:25.098667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.098787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.098908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.099969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.100930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.101912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.102958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.103070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.103684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.103869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.104917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.105979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.106992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.107904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.108948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.109916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.110959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.111987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.112909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.113930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.114987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.115976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.116917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.117902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.118849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.119678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.119815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.119945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.120910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.121911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.122977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.123922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.external = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.external = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.124899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.password = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] auth.token = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.password = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.125894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] auth.token = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.126975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.127914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.128918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.129874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.130891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.131953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.132904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.133887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.135943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.136953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.137951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.138897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.139956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.140888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.141987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.142936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.143886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.144961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.145922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.146976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.147919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.148974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.149988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.150908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.151959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.152915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.153947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.154888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.155970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.156904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] role.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.157991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] role.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.158923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] role.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] role.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.159991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.160936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.161925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.162976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.163942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.164888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.165618 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.166898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.167922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.168975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.169984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.connection = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.170927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.171992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.connection = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.172899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.173961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.174893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 09:02:25.175366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 09:02:25.203127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.203354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.203578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.204023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.204258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.204487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.211952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.213182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.240334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.240561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.241580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.241823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.384130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.385371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.434113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.434343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.435474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.435713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.513426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.513631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.513779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.513887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.514875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.547953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.548788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.577061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.577269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.589864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590180 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.590922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.591005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.591131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.591223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.591357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 09:02:25.608773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.608976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:02:25.609210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.609210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:02:25.609474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.609474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:02:25.609710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.609786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 09:02:25.609858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.610811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.622859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.623000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.630916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.631242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.634211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.635025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.635205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.635292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.635571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.635727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.635853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.635939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.636988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.637932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.638215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.664770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.665832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.666429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.666706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.667640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.667921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.671928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.672208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.672488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.673222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.673502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.673804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.679729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.680008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.681064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.681481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.684924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.685202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.685480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.685786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.686327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.686853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.687046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.687318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.687589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.687856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.688118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.706357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.706627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.707413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.707690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.711299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.712374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.715539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.715825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.716620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.716914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.720810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.722003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.724427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.725634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.728228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.728523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.728808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.729083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.729359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.729523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.729658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.729842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.730146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.730428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.730716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.730993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.748555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.748925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.749190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.749454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.750204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.750584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.750853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.751120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.757332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.759041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.759126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.759313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.761370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.761690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.763087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.763356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.763629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.764162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.764451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.765034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.765314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.765620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.765903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.766188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.778474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.778749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.779033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.779309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.779583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.779871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.780143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.780493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.780773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.781054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.781334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.781646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.781931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.782206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.799428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.801724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.802704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.805040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.806006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.807833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.808881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.809454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.809754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.810029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.810112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.811712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.811992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.812273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.817385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.819158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.819721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.821424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.822902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.823183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.823461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.823747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.825380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.825700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.826006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.826315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.832956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.833187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.833470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.835556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.835845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.836125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.841958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.842230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.842502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.842770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.843044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.843303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.843585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.843854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.844116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.844383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.844650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.844803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 09:02:25.844889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.845935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.846212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.846496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.846760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.847025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.847298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.847570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.847827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.848096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.848370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 09:02:25.884684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e19bb19c0 pid: 80464 (default app) Jul 21 09:02:25.887638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e19bb19c0 pid: 80463 (default app) Jul 21 09:02:25.888025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f63b-b2a7-4387-92fd-2829e211f895 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:25.888316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f63b-b2a7-4387-92fd-2829e211f895 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:25.888656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f63b-b2a7-4387-92fd-2829e211f895 None None] PATH_INFO: `/v3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:25.893084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Thu Jul 21 09:02:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:34.590270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:34.590843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:34.590843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:34.595185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:02:34.600967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:34.601372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:34.601525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:34.673709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: INFO dbcounter [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] Registered counter for database keystone Jul 21 09:02:34.695340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG oslo_db.sqlalchemy.engines [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 09:02:34.702388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writer thread running {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 09:02:34.884837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG passlib.handlers.bcrypt [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80464) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 09:02:34.885165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG passlib.handlers.bcrypt [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80464) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 09:02:34.940670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:34.942341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:35.067438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 09:02:35.262392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:35.333380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: INFO dbcounter [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] Registered counter for database keystone Jul 21 09:02:35.353929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG oslo_db.sqlalchemy.engines [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 09:02:35.360129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writer thread running {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 09:02:35.479187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb984f-9e86-4d03-97d3-2ec086c5d2fe None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:35.483508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:35.484187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:35.484473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:35.484750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:35.493552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:35.544961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 09:02:35.545235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264d52-da58-4984-abd2-2f93e6b2f3de admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:35.555522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 21 09:02:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:02:35.561543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:35.576653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdfe16-238a-4d77-9c85-d93c2a99a3a4 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:35.581047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:35.582201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:35.582489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:35.582764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] PATH_INFO: `/v3/projects/97e449c5adf9473b93e84773b7f3aad3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:35.587586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] RBAC: Authorizing `identity:get_project(project_id=97e449c5adf9473b93e84773b7f3aad3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:35.639296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING keystone.common.rbac_enforcer.enforcer [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 09:02:35.639861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e0dd3-4ae8-4852-9183-e1038963193a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:35.644268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Jul 21 09:02:35 2022] GET /identity/v3/projects/97e449c5adf9473b93e84773b7f3aad3 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:37.665289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bf7f-ea42-4f8f-952c-75b325db1d89 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:37.666007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bf7f-ea42-4f8f-952c-75b325db1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:37.666007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46bf7f-ea42-4f8f-952c-75b325db1d89 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:37.670001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:37.675508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:37.675898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:37.676069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:37.696313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:37.698060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:37.706196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 09:02:37.728683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46bf7f-ea42-4f8f-952c-75b325db1d89 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:37.740933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46bf7f-ea42-4f8f-952c-75b325db1d89 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:37.745300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:37.745966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:37.746254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:37.746533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:37.754597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:37.756401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878160e7-e6a6-47cb-a657-744e9854f1f5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:37.766595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 21 09:02:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:02:37.772338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:37.782402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353f4c-9a88-429e-a2b6-3444d9930638 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:37.786932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:37.787820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:37.788108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:37.788440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:37.789881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:37.791729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7277f6d-42f3-45ad-9bb3-99976249afb1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:37.793351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Jul 21 09:02:37 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:39.913067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5ef4-a0c2-4efe-a2f6-6e8e59c0b9ba None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:39.913640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5ef4-a0c2-4efe-a2f6-6e8e59c0b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:39.913810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5ef4-a0c2-4efe-a2f6-6e8e59c0b9ba None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:39.915697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:39.921012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:39.921432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:39.921741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:39.928220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796c775-e2f0-4826-abbb-74bf67077040 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:39.928510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796c775-e2f0-4826-abbb-74bf67077040 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:39.928789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796c775-e2f0-4826-abbb-74bf67077040 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:39.930906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:02:39.936222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:39.936510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:39.936786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:39.939646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:39.940846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:39.976284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG passlib.handlers.bcrypt [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80463) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 09:02:39.977217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG passlib.handlers.bcrypt [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80463) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 09:02:40.023234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:40.024766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:40.024922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:40.047876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.072723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.128257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:02:40.151422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.152527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edcb88-a8f8-48c2-a7bb-20e9884649ca None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.186985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.187715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.188086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.188271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.199376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:40.210487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:40.211611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:02:40.212519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:02:40.217638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.256156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba24f-2fcb-4474-bde2-da40fe9a48dd None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.258563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.295100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.296001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.296334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.296567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.300947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.322366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9899a90-3f20-47c0-b481-c0f8a4cae1b2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.357713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.358391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.358671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.358946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.359702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:40.360004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.361419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.373317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:40.373716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.375313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.378923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.473900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:02:40.478762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a715-303d-4e12-851a-33473b40f192 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.480668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.483475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.513510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.514427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.514712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.515020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.516256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.517810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.519459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:40.525450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.540558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.581942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2d31-609b-4c5b-a518-d0782ecc9b87 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.619524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.620325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.620608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.620883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.631876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422aa30-9475-4aea-bb58-6b2b74b51dee None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.641583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.643069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:02:40.664913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:40.665972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:40.671516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:02:40.671516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:02:40.671516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:02:40.671516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:40.671516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:02:40.672211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.673479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535068-753c-414d-8be2-4159404a6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.674339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535068-753c-414d-8be2-4159404a6ead None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.674629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535068-753c-414d-8be2-4159404a6ead None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.675122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535068-753c-414d-8be2-4159404a6ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.677141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535068-753c-414d-8be2-4159404a6ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.678662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535068-753c-414d-8be2-4159404a6ead None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.680477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:40.686108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535068-753c-414d-8be2-4159404a6ead None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:40.729809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.770551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:40.774886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d6f19-7e44-4b3e-bece-734ac8264dea None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.790610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535068-753c-414d-8be2-4159404a6ead None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:40.810724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.811469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.811817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.812155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.812883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:40.813189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.814785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b03a0-c5c0-4ee6-ac60-528f084c77db None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.826092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:40.826751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:40.827037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:40.827313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:40.828144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.domain.id=default, user.id=296495a1ad1f4210a892e5227d3c8067) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:40.828458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:40.829912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc196-6d8e-436d-b95b-5a5e89848ec8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:40.832716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:40.840541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 21 09:02:40 2022] GET /identity/v3/role_assignments?user.id=296495a1ad1f4210a892e5227d3c8067&scope.domain.id=default&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:43.078863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2887f-a1a2-4473-86fa-fff0fd82e954 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.079377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2887f-a1a2-4473-86fa-fff0fd82e954 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.079481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2887f-a1a2-4473-86fa-fff0fd82e954 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.080953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:43.086686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485749-148f-40cd-bfad-d0db4a4f0e59 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.087120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485749-148f-40cd-bfad-d0db4a4f0e59 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.087294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485749-148f-40cd-bfad-d0db4a4f0e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.110599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8b485749-148f-40cd-bfad-d0db4a4f0e59 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:43.111839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8b485749-148f-40cd-bfad-d0db4a4f0e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:43.195926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:43.230130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2887f-a1a2-4473-86fa-fff0fd82e954 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:43.389206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2887f-a1a2-4473-86fa-fff0fd82e954 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:43.414037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:43.440721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda046-bd8f-49f9-96eb-dbca2534fced None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.441267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda046-bd8f-49f9-96eb-dbca2534fced None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.441740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda046-bd8f-49f9-96eb-dbca2534fced None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.442147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762937c-c05a-4662-b730-221b67c688da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:43.442956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762937c-c05a-4662-b730-221b67c688da None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.443246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762937c-c05a-4662-b730-221b67c688da None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.443527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762937c-c05a-4662-b730-221b67c688da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.443964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:02:43.449954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a6f5-b91f-4ea5-a019-dbcbd6ebf4cd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.450470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a6f5-b91f-4ea5-a019-dbcbd6ebf4cd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.450898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a6f5-b91f-4ea5-a019-dbcbd6ebf4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.463633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762937c-c05a-4662-b730-221b67c688da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c762937c-c05a-4662-b730-221b67c688da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:43.487126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:43.488054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:43.488802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 12/25] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:43.493583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-22b2a6f5-b91f-4ea5-a019-dbcbd6ebf4cd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:43.493583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-22b2a6f5-b91f-4ea5-a019-dbcbd6ebf4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:43.493760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f044c5-5075-4610-8c51-fbcd065b3e51 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.493760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f044c5-5075-4610-8c51-fbcd065b3e51 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.494079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f044c5-5075-4610-8c51-fbcd065b3e51 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.496961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 13/26] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:43.497738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f044c5-5075-4610-8c51-fbcd065b3e51 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:43.608513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 14/27] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:02:43.609850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.610377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.610855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.618299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:43.631095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:43.632637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:43.683515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f044c5-5075-4610-8c51-fbcd065b3e51 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:43.707964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 15/28] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:43.709192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:43.767455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:43.768128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.768412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.768687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.769442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:43.769776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:43.771172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:43.794512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 14/29] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:43.795154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:43.846832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:43.880058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82efef-6246-4d05-8c13-3377d3f92fa6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:43.916436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680500d-c411-4569-a8c9-079a9047aef6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:43.922178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:43.923159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.923665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.924179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.925240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:43.927047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:43.934300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:43.953330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:43.954089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:43.954378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:43.954649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:43.955416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:43.956802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be44fc7-dedf-4f08-b849-15a65c1ad9c5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.161062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 16/30] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 21 09:02:43 2022] POST /identity/v3/roles => generated 225 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:44.162819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.183455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 15/31] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 21 09:02:43 2022] POST /identity/v3/roles => generated 219 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:44.189842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b016b-c4b5-4778-9b67-18a9f8d816d6 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.193961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b016b-c4b5-4778-9b67-18a9f8d816d6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.194633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b016b-c4b5-4778-9b67-18a9f8d816d6 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.196466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 16/32] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:44.212148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.212889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.213411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.254877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:44.256518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:44.347664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a8f-ecc6-48d7-80eb-8c747640b821 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.389902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.391411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.391922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.392419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.394298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:44.396109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 17/33] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 09:02:44.396575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.398635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 17/34] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:44 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:44.404723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.449852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:44.454949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.529287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f455-3778-4867-8868-e0c024cbeb19 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.540711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:44.566394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.567216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.567582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.567809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.569351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:44.571654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.573690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 18/35] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:44.588596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.597379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffa3b-9edd-4d64-b3b1-add3b94ff49b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.649202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.650393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.651056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.651611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.669979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:44.671818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:02:44.691850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:44.692740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:44.693522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:02:44.693522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:02:44.693522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:02:44.693522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:02:44.696117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 18/36] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:02:44.702976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.721257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:44.727526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee4c2-11d8-456f-9216-cbf90188b231 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.765051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.766291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.766778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.767251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] PATH_INFO: `/v3/domains/default/users/296495a1ad1f4210a892e5227d3c8067/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.769754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=296495a1ad1f4210a892e5227d3c8067, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:44.771427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.828045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc0f6-35e5-468c-a275-55058d4ae145 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.844237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:44.865203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.865911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.866255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.866551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.867935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:44.868274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:44.869691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeab46-b199-4044-be75-1de0b172b7b9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:44.882394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 19/37] 10.222.0.67 () {58 vars in 1361 bytes} [Thu Jul 21 09:02:44 2022] PUT /identity/v3/domains/default/users/296495a1ad1f4210a892e5227d3c8067/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:02:44.896668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 19/38] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:44.898465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.979056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f043b-b357-47ab-9b1d-2fa42003d8e3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.979241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f043b-b357-47ab-9b1d-2fa42003d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.979524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f043b-b357-47ab-9b1d-2fa42003d8e3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.980922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 20/39] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:02:44.983927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c96-f2b5-477d-a716-cebb95280dd7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.984219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c96-f2b5-477d-a716-cebb95280dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.984503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c96-f2b5-477d-a716-cebb95280dd7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.986176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 21/40] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:44.987177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.987472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.987755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.008645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:45.010370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:45.018127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4ef2-7e42-4ee3-a2e3-51d729d93947 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:45.061862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:45.061862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:45.062237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:45.062612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.063451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:45.065068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c01af2-273c-480c-a743-616d37eef91c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:45.185210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:02:44 2022] POST /identity/v3/projects => generated 301 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:45.186624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:45.186930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:45.187290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.201617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 22/42] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:45.212274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:45.213826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:45.216376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:45.225895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:45.313854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 21/43] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:45.339488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:45.360803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045e228-f3f1-4bf6-976a-878fc3fd7f0f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:45.364288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:45.405522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:45.406293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:45.406839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:45.407129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.407912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:45.409994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:45.452433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176860-5cb0-4dbe-8fdc-c864f2d04bef None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:45.488576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:45.489383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:45.489706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:45.489990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.491420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:45.491518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 21 09:02:45 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:45.493716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952bf16-6a53-48fd-83de-7857e24dc1bd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:45.495362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 22/45] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:45.508455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:45.621192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d360e-fc20-4b44-aa6e-75889eaa5a86 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:45.660716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:45.661388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:45.661712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:45.661995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:45.662717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:45.664213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82f20-fb8b-4c9d-8456-d29bae6639b8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:45.753447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:02:45 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:46.992500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdc89-fdaf-4e21-9dac-177926e8a29a None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:46.993503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdc89-fdaf-4e21-9dac-177926e8a29a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:46.993685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdc89-fdaf-4e21-9dac-177926e8a29a None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:46.995109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 23/47] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:47.000451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.000854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.001019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.018224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:47.019405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:47.030652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.087294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 25/48] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:47.110511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdc89-fdaf-4e21-9dac-177926e8a29a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.119700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.320768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdc89-fdaf-4e21-9dac-177926e8a29a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:47.355970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:47.356766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.357054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.357330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.367755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:47.375498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:47.376473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:47.377407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 24/49] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:47.384640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.484426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26716c13-27ac-4a60-bcbd-8c7ea6698202 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:47.518814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:47.519492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.519778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.520060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.520825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:47.521144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:47.522579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:47.531183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 26/50] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:47.536819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.602055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.637058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716086-f7da-4d97-be68-50d8d53f18bc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:47.670490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:47.671373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.671662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.672031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.673238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:47.674759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:47.676450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 25/51] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:47.683183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.695248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.786734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbef0-acaa-4471-841a-b9c636cc6e91 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:47.821236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:47.822070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.822406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.822688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.823874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:47.825410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b3949-fb4a-4821-9cb8-6acb9212a06f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:47.827069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 27/52] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:47.832932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.841979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5a51-b7a1-4022-a86c-94f19089dab2 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.842270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5a51-b7a1-4022-a86c-94f19089dab2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.842549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5a51-b7a1-4022-a86c-94f19089dab2 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.843908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 28/53] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:02:47.848796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.849087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.849361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.866237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:47.867859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:47.936695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2d44-fea6-4e4a-8f50-5155f77ee1a4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:47.938812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 29/54] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:02:47.964396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:47.972466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:47.972894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.973250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:47.973542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:47.973863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:47.974699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.domain.id=default, user.id=296495a1ad1f4210a892e5227d3c8067) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:47.975019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:47.977186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:47.979857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:47.986466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 26/55] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/role_assignments?user.id=296495a1ad1f4210a892e5227d3c8067&scope.domain.id=default&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:48.082500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef238d1-03d0-4e83-9a2f-6ebd5925fece None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:48.119740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:48.120854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:48.120854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:48.121078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:48.122355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:48.123845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793e7ee-93d0-43d6-a43e-dfc004878dd1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:48.125515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 30/56] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:48.131349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:48.240111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be005c-0ec5-4a19-a52e-9a9f5d2d9f0d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:48.275024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:48.275702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:48.275996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:48.276281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:48.277000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:48.278516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8f75b-31e4-43bb-9542-1c12a94a7b81 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:48.361199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 27/57] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 21 09:02:48 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:50.442670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee16d-c18d-4482-8b69-9b84712b163c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:50.443211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee16d-c18d-4482-8b69-9b84712b163c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:50.443211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ee16d-c18d-4482-8b69-9b84712b163c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:50.445148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 31/58] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:50.450887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:50.451312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:50.451447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:50.469213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:50.470443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:50.516093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:50.536529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 28/59] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:50.561512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ee16d-c18d-4482-8b69-9b84712b163c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:50.640533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:50.665377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ee16d-c18d-4482-8b69-9b84712b163c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:50.710969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:50.711778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:50.712058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:50.712334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:50.713556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:50.715038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330ac54-34de-4871-b649-997fb99a5a0e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:50.716666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 32/60] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:50.722486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:50.821056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7a51d-8b86-48bc-b039-bfd1ea7cd147 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:50.855039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:50.855724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:50.856006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:50.856285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:50.857010 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:50.858588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184baf-8296-4cc0-bb1d-3d9a292ea398 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:50.968532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 29/61] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:02:50 2022] POST /identity/v3/users => generated 275 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:02:54.366109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff317-6f56-4d02-a8b5-62c3f7fd0460 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.367079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff317-6f56-4d02-a8b5-62c3f7fd0460 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.367562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ff317-6f56-4d02-a8b5-62c3f7fd0460 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.369591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 33/62] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:54.374878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.376833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba931-cb6a-44db-99ab-61ac8062c0b9 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.377340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.377849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.379718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba931-cb6a-44db-99ab-61ac8062c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.380224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba931-cb6a-44db-99ab-61ac8062c0b9 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.384894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 34/63] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:54.388245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.388756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.389232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.412717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:54.417023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:54.423542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:54.426075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:54.465092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:54.508339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 30/64] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:54.532905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 35/65] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:54.535786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:54.576635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:54.665507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1dc2d-f3de-461b-8e65-7fa247f9f176 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:54.707954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:54.709082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.709550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.710083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.714722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:54.722960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7e9251aa-58b0-4132-806c-18018cb86cc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:54.731936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:54.732767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:54.733528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:54.735913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 31/66] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:02:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:54.737387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d07f2-070f-4e66-a0ae-8aaee3ec2f7a None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.737931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d07f2-070f-4e66-a0ae-8aaee3ec2f7a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.738410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d07f2-070f-4e66-a0ae-8aaee3ec2f7a None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.739935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 32/67] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:54.746542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d07f2-070f-4e66-a0ae-8aaee3ec2f7a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:54.777962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:54.781281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faef59d-8695-4b85-8079-0d78c91efd85 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:54.843907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:54.845176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.845727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.846226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.861988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d07f2-070f-4e66-a0ae-8aaee3ec2f7a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:54.865238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-16eac944-ca6c-46f3-8269-611401f0c55c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:54.880734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:54.882284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:02:54.883153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:02:54.883745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 36/68] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:54.885738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99cd9-5ab7-4f9e-910d-23a304422a56 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.886249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99cd9-5ab7-4f9e-910d-23a304422a56 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.886987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99cd9-5ab7-4f9e-910d-23a304422a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.904719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:54.905753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:54.906219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:54.906672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:54.907600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:54.908104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:54.909718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:54.915579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a2f99cd9-5ab7-4f9e-910d-23a304422a56 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:54.917638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a2f99cd9-5ab7-4f9e-910d-23a304422a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:54.920190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 33/69] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:54.921223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.008871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 37/70] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:55.010452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1399-2940-4d71-a990-4f114f08afb9 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.010708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1399-2940-4d71-a990-4f114f08afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.010987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1399-2940-4d71-a990-4f114f08afb9 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.015899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.016671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 38/71] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:55.017261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1399-2940-4d71-a990-4f114f08afb9 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.031355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec13-3ea5-4a26-a1e9-6c9073cc617a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.066876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.067566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.067865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.068152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.068914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:55.069816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.071217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1070f-a3ff-4e1a-982a-bee57c5e4e2a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.079631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 34/72] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:55.080897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d6a-0e5f-4eae-a5a5-868990cf82ae None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.081193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d6a-0e5f-4eae-a5a5-868990cf82ae None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.081475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850d6a-0e5f-4eae-a5a5-868990cf82ae None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.082747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 35/73] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:55.083800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.084127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.084558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.099254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.101622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:55.102848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:55.139598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1399-2940-4d71-a990-4f114f08afb9 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.173182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 36/74] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:55.174131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.187935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.188944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.189222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.189644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.190869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.192352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.198811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 39/75] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:55.198811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.263473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.282639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06452ab-c00f-41b0-ae66-742164732cbb None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.299470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0afbb6-2cbd-4c6c-a15c-d7e822f988dd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.321598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.322415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.322849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.323142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.333609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:55.333805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.340401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.341289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.341605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-23bf71c6-d7ee-46c5-8ca4-072aebe2a8ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:55.341733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:55.342741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:02:55.343798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:55.344684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.344764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 37/76] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:55.346828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.352722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.352722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.359088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.360482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.362302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 40/77] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:55.363133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.364019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:55.365234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:55.434175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 38/78] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:55.435837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.468331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e595f-0aa1-4870-9bfa-424a4ef18648 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.502493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.503153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.503449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.503732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.514623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.544429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534887e2-2bf9-4095-8abb-1410018eb28b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.560958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.574291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.575823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.579477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.580306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.580581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.580858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.582156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.583620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.585409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 39/79] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:55.586163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.677623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 41/80] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:02:55.678341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.687630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9093-f162-40a7-bd2f-e50e3d6d431d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.721368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.722069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.722358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.722638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.723387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:55.723714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.725070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.730751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.736913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 40/81] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:55.736913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.772756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.784869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebb8c4-3a3c-45e7-8e06-0679489a5f8e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.823779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.824859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.825147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.825425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.837416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb22e-1354-4cfe-9c31-199f98ededbd None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:55.872879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:55.873765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:55.874055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:55.874338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:55.884550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:55.893625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:55.894515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:02:55.895272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:02:55.895849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:55.895917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 41/82] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:55.895979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:55.896040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:55.955451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.988749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:55.998713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330509b-1e27-48f7-9eb5-85eb49c0d12d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.002131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 42/83] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:02:56.002959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.033933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.034612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.034896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.035171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.036096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.037380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.102627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca843866-8b93-49bb-bf4e-a04ada400bb3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.135738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.136859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.137146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.137426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.139040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.140653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.142465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 43/84] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.143290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 42/85] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:02:55 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:02:56.143396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.144031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.217953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.264740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17222-5f57-41a6-ade2-e00f8c5980ad None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.270789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48227765-78ec-4764-b5d9-b61bd8160573 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.283359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.311016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.311801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.312087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.312368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.313123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:56.313434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.314954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.315181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.316067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.316353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.316630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.317906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.319572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.321700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 44/86] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.325635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.327277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 43/87] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.328123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.448128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2cae4-1473-4f8a-8b9f-a0bdacad9928 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.451599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f719-c111-428b-a743-e917bced4b92 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.477392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.489140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.489838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.490118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.490396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.492022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=296495a1ad1f4210a892e5227d3c8067) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:56.492441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.492636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.493514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.493839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.494006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.494154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.498053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.500407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.502091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 44/88] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/role_assignments?user.id=296495a1ad1f4210a892e5227d3c8067&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.502607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 45/89] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.503478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.504440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.569693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.662009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435f5-704b-4225-bb5a-2157900c11db None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.722498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed36bb0-6bde-4e13-90a2-72a806857ee3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:56.733943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.734537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.734824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.735100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.788562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:56.790461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:56.790998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:56.791481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:56.798347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.800121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.802079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 46/90] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:56.803080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:56.842131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:56.844055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:56.903511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.924212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:56.982446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba647-6b3c-4b9c-b676-d3b177342754 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.010017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 45/91] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:02:57.010868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:57.045896 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.046572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.046858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.047141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.047987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:57.048305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.049821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.058339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 47/92] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:02:56 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=b2a89d6203584406a6a215144e4dee65 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:57.059210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:57.171935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c296f2-5d0b-4187-ada1-ca1e00d68ce8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.203535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:57.214337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.215261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.215549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.215831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] PATH_INFO: `/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.217168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=67ec47c49e4d406dafa9c8cdfa3c61f3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.218686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.220697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 48/93] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:02:57 2022] GET /identity/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:57.227727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:57.255257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f32ab1-1c56-42cf-a7bc-d5374ad6c705 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.292771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.293357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.293674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.294036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.314440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:57.373012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.374656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.417451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf78b9-dbcc-43bf-91cb-b214cb2c6ec1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.489426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.490177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.490407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.490732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.501497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=67ec47c49e4d406dafa9c8cdfa3c61f3, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:57.501497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.501497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.508192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 49/94] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:02:57 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=67ec47c49e4d406dafa9c8cdfa3c61f3&role.id=b2a89d6203584406a6a215144e4dee65 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:02:57.517852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 46/95] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:02:57.527068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:57.617221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:57.675695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acaa06-a761-41d3-a64a-9946d9ee0a4d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.731196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.732253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.732548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.732827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.734090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.735550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b1a0-e0e6-4496-bd90-1946e3a3a9c4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.737607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 50/96] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:02:57 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:57.743896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:57.806979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:57.872357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0b952-44af-4152-a03c-f024f4f362c4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:57.913544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:57.914290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:57.914576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:57.914854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:57.915799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:57.916062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:57.917537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0246c6e-2abd-4c80-8021-ca49d91cd009 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:57.923467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 47/97] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:02:57 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:58.672732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb9b2-9918-4168-a84e-a054524f36b0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:58.673239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb9b2-9918-4168-a84e-a054524f36b0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:58.673313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb9b2-9918-4168-a84e-a054524f36b0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:58.674690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 51/98] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:58.681075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:58.681536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:58.681762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:58.706607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:58.707873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:58.796041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 48/99] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:58.829897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb9b2-9918-4168-a84e-a054524f36b0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:58.953784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb9b2-9918-4168-a84e-a054524f36b0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:58.981146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:58.993554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:58.994529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:58.994816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:58.995091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.006895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:59.015071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:59.015942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:02:59.018183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 52/100] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:02:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:59.023662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.066405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.160678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1aadf4-ae1c-43b6-bc3f-e7eed6a893a5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:59.206677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:59.207288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.207575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.207856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.208624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:02:59.208936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:59.211164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89f937-fc34-42a1-91d7-eca681517833 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:59.226885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 49/101] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:59.232281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.258653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2d12-238a-45d0-a3e9-77901e416aaa None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.259043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2d12-238a-45d0-a3e9-77901e416aaa None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.259249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2d12-238a-45d0-a3e9-77901e416aaa None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.260839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 50/102] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:59.268643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4069-39a0-4dc7-8439-6385990db615 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.269420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4069-39a0-4dc7-8439-6385990db615 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.270362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4069-39a0-4dc7-8439-6385990db615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.293604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-989a4069-39a0-4dc7-8439-6385990db615 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:59.295301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-989a4069-39a0-4dc7-8439-6385990db615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:59.397186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 51/103] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:02:59.397186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447dcd-d4cf-4571-a1bc-878aed674766 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.397186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447dcd-d4cf-4571-a1bc-878aed674766 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.397186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447dcd-d4cf-4571-a1bc-878aed674766 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.397186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 52/104] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:02:59.400616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0554-90c9-498d-a371-a0977da184e5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:59.403124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.403418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.403702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.421660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:02:59.422853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:59.454140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.470239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:59.470239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.470239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.470239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] PATH_INFO: `/v3/users/bca2cd62f2064d84843d907ddb8f1920` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.488351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] RBAC: Authorizing `identity:get_user(user_id=bca2cd62f2064d84843d907ddb8f1920)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:59.499155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:59.499155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 53/105] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/users/bca2cd62f2064d84843d907ddb8f1920 => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:59.499155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.526298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 53/106] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:02:59.527661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.561791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.625602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e546-76db-427f-9e5f-eb9467602e30 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:59.654902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc072-4be1-4f03-9872-317c998c0933 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:59.664281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:59.665327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.665728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.666088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.667699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:59.669254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:59.671029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 54/107] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:02:59.672127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.698487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:59.700258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.700695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.701366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.733427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.782068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:59.783950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:59.886575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2dc4e-b473-458b-bae6-91cd320280ac None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:59.900966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 54/108] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:02:59.902342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:59.905125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.954199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:59.955030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:59.955325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:59.955605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:59.978439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:59.979190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:02:59.996630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:59.997513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 55/109] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:02:59.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.014858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaefcc-9f8c-4849-9e87-125bb3c07eb2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.059188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.060203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.060723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.061262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.062283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.063958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.157448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 55/110] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:02:59 2022] POST /identity/v3/projects => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:00.158870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.200801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048c5c-c84d-4bab-9b65-16db62a8166e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.271689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.273097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.273592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.273892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.278458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.279960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.282035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 56/111] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:02:59 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:00.288035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.328968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb167-33de-4206-9291-8d59b2ddba05 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.343685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:00.370355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:00.374795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.375873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.376642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.377360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.378436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:00.378970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.380718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.392111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 56/112] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:00.398172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.470842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992d02-2307-469f-b243-f4293834c325 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.519503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.520218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.520606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.520898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.528453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=bca2cd62f2064d84843d907ddb8f1920) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:00.528453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.528453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5881-03e6-4496-8d59-4d3e8d31e789 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.529008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca785a2-d165-463b-a978-46decc6d177e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.532301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 57/113] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:00 2022] GET /identity/v3/role_assignments?user.id=bca2cd62f2064d84843d907ddb8f1920&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=7e0c008a59304807a40545334472eec7 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:00.533466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc96db-9e5a-4ff7-96e1-2c5a6289b467 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.533812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc96db-9e5a-4ff7-96e1-2c5a6289b467 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.534105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc96db-9e5a-4ff7-96e1-2c5a6289b467 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.535640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 58/114] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:00.547518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.547893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.548189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.574042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:00.575293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:00.648509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.649435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.650560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.650847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.652317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.653834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.655773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 57/115] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:00 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:00.662093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.718472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 59/116] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:00.741467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:00.746737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.791879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:00.825157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15bee-4b62-4b0f-b70c-1f7b1a4f4f24 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.894522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.895797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.896324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.896850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.898526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:00.900442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:00.906500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48d16-006d-420e-9f47-7ca2c6e81c23 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:00.908261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 58/117] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:00 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:00.915234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:00.968299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:00.969130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:00.969504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:00.969851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:00.994264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:01.005348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:01.008033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:01.009139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 60/118] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:01.019639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.122575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19e464-9a51-4eb7-8b6d-8b41249708a0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.139761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:01.153931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:01.173108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.174262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.174555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.174842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/296495a1ad1f4210a892e5227d3c8067/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.175980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9830-68b3-445c-bc62-e72610f99795 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.176942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, user_id=296495a1ad1f4210a892e5227d3c8067, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:01.179365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052baa7-f7de-44ab-83c4-1a3443b3f164 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:01.221353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.222077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.222372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.222706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.223528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:01.223908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:01.226637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592aff4-e755-4c2b-80e3-7463005852f5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:01.235956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 61/119] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:01.237256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9fdd3-00f4-49b6-826d-30b9a91262bd None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.237664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9fdd3-00f4-49b6-826d-30b9a91262bd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.237951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9fdd3-00f4-49b6-826d-30b9a91262bd None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.239536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 62/120] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:01.250066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9fdd3-00f4-49b6-826d-30b9a91262bd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.251016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 59/121] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:00 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/296495a1ad1f4210a892e5227d3c8067/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:01.252383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211329-e6ed-4d5a-99f2-58474f50f73e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.252897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211329-e6ed-4d5a-99f2-58474f50f73e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.253414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211329-e6ed-4d5a-99f2-58474f50f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.276633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e9211329-e6ed-4d5a-99f2-58474f50f73e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:01.277969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e9211329-e6ed-4d5a-99f2-58474f50f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:01.427196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 60/122] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:01.428541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02358d-a861-4ff6-b6a0-40716f132899 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.428848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02358d-a861-4ff6-b6a0-40716f132899 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.429137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02358d-a861-4ff6-b6a0-40716f132899 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.430458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 61/123] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:01.442973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.443270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.443593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.445242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9fdd3-00f4-49b6-826d-30b9a91262bd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.484268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:01.493441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 63/124] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:01.493968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.498717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:01.499964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:01.529392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:01.620569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 62/125] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:01.621260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.627863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b717d-a0f0-4562-a47b-f856aa37b767 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.653465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:01.673194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.674048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.674337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.674659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.689492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:01.701431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:01.702368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:01.703110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 64/126] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:01.704320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.745040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b2b3-f140-4e29-b3dd-b6f8039b5b62 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.816072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.816958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.817246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.817524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.820739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:01.825551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:01.829856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 63/127] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:01.832017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:01.845937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:01.879723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df226979-f3b9-4c31-9450-39d7f0347c9f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:01.924365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:01.925251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:01.925548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:01.925913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:01.939223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:01.948758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:01.949676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:01.950447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 65/128] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:01.951099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.070442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe4c0-7826-43ab-807c-02ec59ed8973 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.109183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.110885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.111187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.111473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/f63981a677064006bf748d47264bd29b/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.113781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, user_id=f63981a677064006bf748d47264bd29b, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.115344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.138701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.145042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a5881-59e3-4f80-a2df-7df152e35777 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.182741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.183427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.183715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.184000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.184817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:02.185136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.186613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.196343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 64/129] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:02.197074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.218343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 66/130] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:01 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/f63981a677064006bf748d47264bd29b/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:02.218343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.218343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.344352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2c0a-3888-43fc-b0e1-196c5f3fa18e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.360889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98978e-5eef-49be-994d-b1b724c9aa98 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.383127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.383816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.384108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.384390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.385152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:02.385466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.387178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.396433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 65/131] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:02.404920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.405114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.406350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.406854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.407331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.408819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.410643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.413597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 67/132] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:02 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:02.422697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.448380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.541138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.576669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b4b3-8c6c-4750-95f9-cc2f846aaee3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.602009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a368e4-c8a2-4694-94bb-0dc82bb60f14 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.617428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.618695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.619221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.619724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] PATH_INFO: `/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.621524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] RBAC: Authorizing `identity:get_project(project_id=67ec47c49e4d406dafa9c8cdfa3c61f3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.623356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.625403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 68/133] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:02 2022] GET /identity/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:02.631778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.664147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.665395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.667433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.669378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.671056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.673754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.681698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 66/134] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:02 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:02.687620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.843859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6233-518a-40d4-a5ca-8fea6963b76a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.873957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.887623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa7fb-b33d-4da1-a06a-33809c09803b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:02.895190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.896439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.896941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.897434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] PATH_INFO: `/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3/users/f63981a677064006bf748d47264bd29b/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.906449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] RBAC: Authorizing `identity:create_grant(project_id=67ec47c49e4d406dafa9c8cdfa3c61f3, user_id=f63981a677064006bf748d47264bd29b, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.908792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57605b-0471-4629-8842-38bb6b78b008 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.922580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201af2-878e-490a-869d-223924358845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:02.923472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201af2-878e-490a-869d-223924358845 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:02.927326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201af2-878e-490a-869d-223924358845 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:02.927326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201af2-878e-490a-869d-223924358845 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:02.927326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1201af2-878e-490a-869d-223924358845 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:02.927326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1201af2-878e-490a-869d-223924358845 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:02.929381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 67/135] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:02 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:02.935427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201af2-878e-490a-869d-223924358845 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:02.990865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:02.999061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 69/136] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:02 2022] PUT /identity/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3/users/f63981a677064006bf748d47264bd29b/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:03.047095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201af2-878e-490a-869d-223924358845 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:03.085159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:03.086475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.086765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.087049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/f63981a677064006bf748d47264bd29b/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.089375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, user_id=f63981a677064006bf748d47264bd29b, role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:03.090915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbabac-9a88-4dc5-8111-3652fab602e4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:03.154613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 68/137] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:02 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/f63981a677064006bf748d47264bd29b/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:03.431943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf6ee-d3f3-4512-bd37-7b793f4ba0ad None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.432571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf6ee-d3f3-4512-bd37-7b793f4ba0ad None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.433074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf6ee-d3f3-4512-bd37-7b793f4ba0ad None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.434869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 70/138] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:03.440825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.441125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.441415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.464376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:03.465634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:03.478000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:03.485139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf9e54-5e3d-4f58-8ce6-385aec156bf5 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.485770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf9e54-5e3d-4f58-8ce6-385aec156bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.486273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf9e54-5e3d-4f58-8ce6-385aec156bf5 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.487864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 71/139] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:03.496543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.497133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.497652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.524349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:03.525969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:03.549051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 69/140] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:03.577727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:03.661038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 72/141] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:03.699073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:03.796523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e8ee-4a91-4101-b879-a4cbbdda9a0d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:03.859334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:03.860381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.860805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.861133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.866557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:03.868157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:03.870087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 70/142] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:03.875771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:03.895324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:03.915610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37b34-2e3b-4db6-bbb1-e3fd7f0a2105 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:03.964450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:03.979330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:03.980183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:03.980551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:03.980844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:03.987053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b93fe-6fd8-4548-b24e-93a6e88c0596 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.002864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:04.018266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:04.019190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:04.019943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 73/143] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:04.024476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:04.025171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.025622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.025885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.026552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:04.026658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:04.028192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:04.110454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 71/144] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:03 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:04.187199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cca39-c3d5-4448-955a-6a0dc25c2f9d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.236230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:04.236902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.237192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.237470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.238288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:04.238568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:04.240085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:04.251981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 74/145] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:04.257744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:04.351205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:04.390898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32379b76-58da-46ea-a344-7dbf9b1d24eb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.437461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:04.438442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.438730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.439007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] PATH_INFO: `/v3/users/bca2cd62f2064d84843d907ddb8f1920` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.440295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] RBAC: Authorizing `identity:get_user(user_id=bca2cd62f2064d84843d907ddb8f1920)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:04.441779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5601-dd70-4c99-b425-9b6e9b6b8565 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:04.443664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 72/146] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:04 2022] GET /identity/v3/users/bca2cd62f2064d84843d907ddb8f1920 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:04.451803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:04.468427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04753b-fdfd-4d7a-872e-1b3b2d1581b0 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.468733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04753b-fdfd-4d7a-872e-1b3b2d1581b0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.468987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04753b-fdfd-4d7a-872e-1b3b2d1581b0 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.470401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 73/147] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:04.476638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.476927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.477208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.506701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:04.507842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:04.549852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:04.637774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe26d1-5717-4f5a-88e4-36169d3b8329 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.677316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:04.678223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.679015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.679298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.680551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:04.682068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:04.685009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 75/148] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:04 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:04.690998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:04.704215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 74/149] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:04.753039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:04.846778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944709b0-cfbd-464e-b061-ca8382f0307d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.874826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:04.902244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:04.903783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:04.904223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:04.904510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/bca2cd62f2064d84843d907ddb8f1920/roles/7e0c008a59304807a40545334472eec7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:04.906735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, user_id=bca2cd62f2064d84843d907ddb8f1920, role_id=7e0c008a59304807a40545334472eec7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:04.908438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:04.927299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:04.969160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2090ef-6e9c-4489-b5ff-aed1cb28ce4b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:04.984857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 76/150] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:04 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/users/bca2cd62f2064d84843d907ddb8f1920/roles/7e0c008a59304807a40545334472eec7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:05.011505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:05.012367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.012705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.012985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.029353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:05.038306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:05.039239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:05.040006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:05.042167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 75/151] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:05.046407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:05.163782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc2da-444a-426a-ad6b-1647d36a5e08 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:05.201361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:05.202330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.202773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.203189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.204105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:05.204549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:05.206160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:05.216250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 77/152] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:05.222292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:05.346961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696d124-4750-42f5-bbaf-900776de2790 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:05.382255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:05.391543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:05.392670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.393093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.393635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] PATH_INFO: `/v3/users/296495a1ad1f4210a892e5227d3c8067` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.398286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] RBAC: Authorizing `identity:get_user(user_id=296495a1ad1f4210a892e5227d3c8067)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:05.401582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:05.401704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 76/153] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:05 2022] GET /identity/v3/users/296495a1ad1f4210a892e5227d3c8067 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:05.407306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:05.461750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:05.539511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5863a-a05d-4049-9346-17f4cb77899d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:05.580079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:05.580746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.581028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.581342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.653696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:05.655178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d26c6-a61a-4a1e-b279-c8b5ebb82df4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:05.698734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:05.763243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 78/154] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:05.767822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:05.878675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9e835-3d25-4dd7-98b9-ea5f00030148 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:05.908882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660950e2-73b3-4a98-be63-a4dde58000c7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.909186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660950e2-73b3-4a98-be63-a4dde58000c7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.909427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660950e2-73b3-4a98-be63-a4dde58000c7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.910958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 79/155] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:05.917464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.917763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.918039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.937433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:05.938342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:05.938623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:05.938897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:05.940330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:05.941505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:05.944955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:05.946471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:05.948247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 77/156] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:05 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:05.955919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:06.043943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:06.079276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 80/157] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:06.106261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53039-676e-4f98-b714-1f64d127a4dc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:06.118667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:06.197986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:06.198657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.198941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.199224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:06.200067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=296495a1ad1f4210a892e5227d3c8067) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:06.200381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:06.201875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771e9db-2282-4994-b4cb-661a0c160fef None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:06.216612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 78/158] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:05 2022] GET /identity/v3/role_assignments?user.id=296495a1ad1f4210a892e5227d3c8067&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:06.253999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:06.299248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357797-39be-477d-8a43-489b6f4e8219 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:06.356673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:06.357589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.357881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.358159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:06.366845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1c-d3b0-4134-9e1a-41754846e1ed None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.367154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1c-d3b0-4134-9e1a-41754846e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.367406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1c-d3b0-4134-9e1a-41754846e1ed None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:06.368828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 79/159] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:06.375340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.375630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.375907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:06.400023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:06.408406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:06.409347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:06.410233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:06.418064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:06.419293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:06.428741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 81/160] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:06.434848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:06.611970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 80/161] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:06.659659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:06.660842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5961d2e-2b9c-4509-8927-2b73e3db5309 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:06.713344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:06.721300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:06.722154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.722441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.722720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:06.723656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:06.723972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:06.726136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:06.741820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 82/162] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:06.750841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:06.803885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:06.944672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241c0c-52ef-429d-b7ee-c766e54f90f2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:06.948404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350c50-ae97-46e4-b2d4-8a342dff6c58 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:06.995185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:06.996317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:06.996759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:06.997169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.000743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:07.002406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:07.004402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 83/163] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:06 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:07.010025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:07.042863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:07.043136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.043430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.043722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.078209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:07.086688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:07.087594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:07.093313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 81/164] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:07.097965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:07.111091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:07.131788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c9f49-fbdd-471b-81b2-04b8043b8545 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:07.168335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:07.169518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.169931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.170305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.244630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:07.246321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca8c4-e717-4206-b12d-d67a74f2f7b0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:07.358734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:07.415727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5af6-82e0-4f6b-8086-351f7dab1c12 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:07.425902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 84/165] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:03:07.427540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47ee7-57e7-42ea-a59d-f296f60f02a1 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.427887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47ee7-57e7-42ea-a59d-f296f60f02a1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.428347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47ee7-57e7-42ea-a59d-f296f60f02a1 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.433793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 85/166] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:07.434712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e47ee7-57e7-42ea-a59d-f296f60f02a1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:07.454714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:07.497832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:07.498445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.498734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.499025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.499785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:07.500200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:07.501845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111c88-3f2f-4d22-a1ea-49901d7c6432 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:07.516939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 82/167] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:07.518242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.518599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.518881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.549394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:07.551309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:07.616891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e47ee7-57e7-42ea-a59d-f296f60f02a1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:07.679738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:07.680921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.681028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 83/168] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:07.681509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.681900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:07.682111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.683466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:07.685081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:07.688010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 86/169] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:07.696082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:07.745111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:07.871690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4278a-853e-44d6-bf1c-6427b9460269 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:07.893277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:07.900931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c47a-4191-4688-93c0-a97beab428bc None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:07.956033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:07.957451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:07.957950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:07.958506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:07.962710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:07.964215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:07.966242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 84/170] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:07.966808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:08.014372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.015059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.015346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.015620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.016585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:08.016904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:08.018432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:08.036150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 87/171] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:08.037758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:08.232584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b3862-fb53-4cf1-a990-f460dfa66003 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:08.322003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:08.331554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.332379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.332665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.332945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.351627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5ce12-e47a-4585-90fd-3d654d185b8d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:08.369041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:08.377619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:08.379889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:08.382488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 85/172] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:08.392622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:08.466457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.467153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.467413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.467693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.477945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:08.608629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23174d-88ee-46ff-96df-e786f9ed759a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:08.620233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:08.621942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d392dd-ffaf-4b4f-a43f-ca7aa08de043 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:08.680313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.681008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.681309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.681590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.682354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:08.682667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:08.684071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:08.700660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 86/173] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:08.705831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:08.829237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 88/174] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:08.830435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651143-bfa8-4853-84b3-c04da4525ab6 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.830806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651143-bfa8-4853-84b3-c04da4525ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.830995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651143-bfa8-4853-84b3-c04da4525ab6 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.832667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:08.836897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 89/175] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:08.838315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a530-c8e6-4179-90e4-6a8aaf97f81b None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.838609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a530-c8e6-4179-90e4-6a8aaf97f81b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.839049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a530-c8e6-4179-90e4-6a8aaf97f81b None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.840576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 90/176] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:08.841280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a530-c8e6-4179-90e4-6a8aaf97f81b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:08.867401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:08.870724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861afdf-b86a-4e51-8640-9d40ca7fe682 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:08.907781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.908671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.908998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.909281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] PATH_INFO: `/v3/users/f63981a677064006bf748d47264bd29b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.910649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] RBAC: Authorizing `identity:get_user(user_id=f63981a677064006bf748d47264bd29b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:08.912790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3f984-1987-4819-8c1f-bbff1c24c34d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:08.915089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 87/177] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:08 2022] GET /identity/v3/users/f63981a677064006bf748d47264bd29b => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:08.916318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.916609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.921416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:08.938764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:08.939980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:08.959333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a530-c8e6-4179-90e4-6a8aaf97f81b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:08.998239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:08.999117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:08.999400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:08.999673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.000993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.002598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9baa-cff5-41cd-a51f-10c9c057a840 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.004620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 91/178] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:08 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.006260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.006548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.006965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.019497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 88/179] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:09.021951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.034810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:09.036042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:09.110862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.124712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 92/180] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:09.125792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.161680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.164800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175788d-294e-4dd6-9409-51c48238a424 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.199475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.200133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.200420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.200700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.236843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8287-24b2-4324-b3d8-eb7764504737 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.269062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.270264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.270583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf246d-9332-47f3-9182-046da6d78511 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.271570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.271890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.272192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.273201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:09.273517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.275744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.281605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 93/181] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=b2a89d6203584406a6a215144e4dee65 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.282390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.354059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.378877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 89/182] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd884f7-216a-4771-8883-a3ba060afa44 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd884f7-216a-4771-8883-a3ba060afa44 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd884f7-216a-4771-8883-a3ba060afa44 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 90/183] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:09.389216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd884f7-216a-4771-8883-a3ba060afa44 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.419117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492deed-30fc-409c-92ba-19e078d27c37 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.461319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.462184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.462472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.462752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.475185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e66a7e00-d12e-4dc9-a747-8b0d907cceef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:09.483130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:09.484194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:09.485043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 94/184] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:09.485788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138403d-ece0-4d26-9f75-2800f81cae11 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.485868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138403d-ece0-4d26-9f75-2800f81cae11 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.486548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138403d-ece0-4d26-9f75-2800f81cae11 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.488936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 95/185] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:09.488936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138403d-ece0-4d26-9f75-2800f81cae11 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.511197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd884f7-216a-4771-8883-a3ba060afa44 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.547135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.547936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.548223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.548501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.558820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-46a654b5-3571-4434-bcaf-a292360570e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:09.566444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:09.567503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:09.568507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 91/186] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:09.569233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.569410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.569712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.592026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:09.592026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:09.600461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138403d-ece0-4d26-9f75-2800f81cae11 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.613730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.633684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.634486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.635046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.635046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] PATH_INFO: `/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.636515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] RBAC: Authorizing `identity:get_project(project_id=67ec47c49e4d406dafa9c8cdfa3c61f3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.638192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71f8d5-3a2a-49d7-965d-de9f06ffa548 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.640473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 96/187] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/projects/67ec47c49e4d406dafa9c8cdfa3c61f3 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.641675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.642669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.643100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.643386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.655833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 92/188] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:09.656833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.662427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:09.663693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:09.733443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 97/189] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:09.734324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.773369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4eb4c-20ad-47d8-a01f-f2551a3fc850 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.806695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.807454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.807745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.808023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.808771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:09.809081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.810513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.819085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 93/190] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.820018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.841539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bb0bb-76be-4c0f-9a68-d5208eb2d5a7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.855055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.870808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:09.875810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.876481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.876763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.877048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.877919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:09.878227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.879720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.889915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 98/191] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.890692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.922114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4498-5aa2-456d-a1a3-0450e7e643db None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:09.954903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:09.955558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:09.955837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:09.956113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:09.956936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=67ec47c49e4d406dafa9c8cdfa3c61f3, user.id=f63981a677064006bf748d47264bd29b) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:09.957246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:09.959308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:09.964952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 94/192] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/role_assignments?user.id=f63981a677064006bf748d47264bd29b&scope.project.id=67ec47c49e4d406dafa9c8cdfa3c61f3&role.id=b2a89d6203584406a6a215144e4dee65 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:09.965755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:09.997406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9890e-45c6-4882-98ba-5efd7ac37bcd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.037296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.038240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.038530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.038843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.040173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.041693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.043530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 99/193] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:10.044160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.094037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.095178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe85ed-b8f0-4333-b015-e1332fda8fb1 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.110801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.133975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.134791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.135075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.135352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.150238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:10.158842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:10.159883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:10.160886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:10.163662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 95/194] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:10.164465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.164566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340298b7-55b2-4fec-811f-ecfa4ea35339 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.209883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.210769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.211052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.211325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.225153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.226673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.228339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 100/195] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:10.229079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.273387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13127a-a45f-42e7-8caf-8c49d640c194 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.312730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.313738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.314020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.314291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] PATH_INFO: `/v3/users/bca2cd62f2064d84843d907ddb8f1920` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.315489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] RBAC: Authorizing `identity:get_user(user_id=bca2cd62f2064d84843d907ddb8f1920)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.316950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.319252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 96/196] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/users/bca2cd62f2064d84843d907ddb8f1920 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:10.319252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.343509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.346638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc726f-1b6a-4f4e-b060-8fb80d958e6a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.367705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.384367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.385033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.385307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.385865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.386573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.388025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.424323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bdac-c8e8-44a8-88d3-55738a290469 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.458217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.458907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.459187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.459464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.460214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:10.460523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.461944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.470136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 97/197] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:10.470945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.492406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 101/198] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:10 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:10.492406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.604435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56be40-a42e-46b6-bb6c-f3090877161f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.608198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.639649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753881-8bd8-4bcc-8cf3-cc37b93da6cf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:10.654369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.655041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.655330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.655611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.691765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:10.692445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:10.692766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:10.693039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:10.727163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.752190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.754115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.783621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:10.785124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:10.889243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 98/199] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:10.890261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.895119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:10.919140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 102/200] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:10.920329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:10.983892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.016451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e12be-11fe-4d9d-956a-ca12b59e1d9e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.032573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a6a9-5eb5-415f-b8b3-5ac58fd20b6c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.054289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.055203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.055493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.055767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.057055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.058615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.060247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 99/201] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.065448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.072454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.073691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.074180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.074678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.076116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.077837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.079835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 103/202] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:10 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.080806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.142527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.175349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7a5f8-c9b6-4821-8a7c-be5ec9e86215 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.196956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4bdaf-a463-4e79-b400-cd3cbf145c06 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.212515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.213676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.214060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.214340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.215585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.217047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.219005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 100/203] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.224958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.232861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.249166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.250627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.251375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.251855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.352258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ff64-b76d-4502-b01c-fdac10902f30 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.353268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.355956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.390234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.391246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.391852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.392446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.393885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=b0c83d4a1faa4f23add252147c77a62e) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:11.394412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.396165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.402458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 101/204] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/role_assignments?user.id=b0c83d4a1faa4f23add252147c77a62e&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.403608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.408222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.486411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 104/205] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:11.493653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.524840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.537591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333dbf7-2359-4527-883a-ef89b33468f4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.595916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.596897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.597393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.597887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.606042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed, user.id=bca2cd62f2064d84843d907ddb8f1920) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:11.606638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.608319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.609486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4741db-52a1-4e8f-a984-7dbedc32af70 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.621587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 102/206] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/role_assignments?user.id=bca2cd62f2064d84843d907ddb8f1920&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=7e0c008a59304807a40545334472eec7 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.684336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.685139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.685426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.685724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.687035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.688511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a5fc1-5d8d-43fa-84a3-513f0b999e3c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.690657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 105/207] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:11.698103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:11.797970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:11.843761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9024d6-22d4-46d0-a96c-bf93b463a81f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:11.886080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:11.886746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:11.887030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:11.887311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:11.888151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=b0c83d4a1faa4f23add252147c77a62e) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:11.888463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:11.889937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76422b0e-c542-49f5-b8f2-0893ea5ada9f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:11.906144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 103/208] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:11 2022] GET /identity/v3/role_assignments?user.id=b0c83d4a1faa4f23add252147c77a62e&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:12.825369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2487-b178-4586-bafd-46cf2324a185 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:12.825914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2487-b178-4586-bafd-46cf2324a185 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:12.825989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2487-b178-4586-bafd-46cf2324a185 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:12.827637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 106/209] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:12.832736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9242-54e8-47c4-a777-d4067e92dbe9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:12.833193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9242-54e8-47c4-a777-d4067e92dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:12.833359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9242-54e8-47c4-a777-d4067e92dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:12.850172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-346b9242-54e8-47c4-a777-d4067e92dbe9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:12.851387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-346b9242-54e8-47c4-a777-d4067e92dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:12.920246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 104/210] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:12.944005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed2487-b178-4586-bafd-46cf2324a185 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:12.981760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4be3a-69d7-4c4f-9952-122f7cdf7f29 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:12.982069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4be3a-69d7-4c4f-9952-122f7cdf7f29 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:12.982331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4be3a-69d7-4c4f-9952-122f7cdf7f29 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:12.983757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 105/211] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:12.988538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:12.988824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:12.989100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.007227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:13.008507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:13.043464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.056069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed2487-b178-4586-bafd-46cf2324a185 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.074725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.085047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 106/212] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:13.099401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.100457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.100817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.101085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.113489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.113766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:13.123497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:13.124414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:13.125200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 107/213] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:13.132842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.245757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53720725-a725-4c9d-bf85-54d01620cea0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.274378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca491-019b-4ff5-b8b8-f594ae6facd3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.283111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.284157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.284641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.285110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.287156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:13.289092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:13.291475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 107/214] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:13.306763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.315642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.316323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.316609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.316889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.318309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:13.318632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:13.320026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:13.331431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 108/215] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:13.338306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.359683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.380900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.428488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dd37-30bc-406c-9971-46dcb9a77e5c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.465068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.465797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.466283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.466390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.467052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:13.468513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69c9c-ee2f-4c4a-9383-ba087f2fc497 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:13.477370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf041f-0868-4197-a49e-3364dd11904a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.514094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.515027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.515314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.515663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] PATH_INFO: `/v3/users/0644936993854204b388342ae5ae6975` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.565772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] RBAC: Authorizing `identity:get_user(user_id=0644936993854204b388342ae5ae6975)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:13.567286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:13.569848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 109/216] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/users/0644936993854204b388342ae5ae6975 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:13.575100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.654062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 108/217] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:13 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:13.655966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.686339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8bb0f-ef22-42f5-8adc-ea173fa789d1 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.686630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8bb0f-ef22-42f5-8adc-ea173fa789d1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.687155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8bb0f-ef22-42f5-8adc-ea173fa789d1 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.688692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 109/218] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:13.693666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f363c-e9cd-4df4-8402-e93266e34088 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.695274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.695531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.695807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.726739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:13.727963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:13.739060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:13.740691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:13.741446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:13.741778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:13.806769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 110/219] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:13.829355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:13.834843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:13.837227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:13.888756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.928699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:13.960401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631bdbc-49ee-4ce5-b149-0f00f7bc0d9d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:13.969381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 110/220] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:03:13.977101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.018224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.019034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.019324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.019602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.040611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:14.048957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:14.050048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:14.050836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:14.051440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 111/221] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:14.057495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.121202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264f5d-6c7e-4be9-9153-559e71242e33 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.163019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.164372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.164654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.165206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.166621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.168714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614ea04-d7cc-4488-b215-f32b5a395a9c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.171463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 111/222] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:13 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:14.172734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab203b-b832-4769-90a8-19c1cc4ea2b0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.173016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab203b-b832-4769-90a8-19c1cc4ea2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.173289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab203b-b832-4769-90a8-19c1cc4ea2b0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.174542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 112/223] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:14.179585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab203b-b832-4769-90a8-19c1cc4ea2b0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.183218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de01e23-c93c-4f32-9ef8-fc7c103ce6c1 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.192692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:14.229695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.230491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.230844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.231196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.232047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:14.232425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.234537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61598e1a-f07e-4a77-bbdb-ec396f414ba6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.235585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:14.247759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 112/224] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:14.249134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.249431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.249754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.276037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:14.277443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:14.325261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab203b-b832-4769-90a8-19c1cc4ea2b0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.371999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.372655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.372992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.373157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 113/225] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:14.373315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.374017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.378221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=0644936993854204b388342ae5ae6975) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:14.378542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.380611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.395182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 113/226] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/role_assignments?user.id=0644936993854204b388342ae5ae6975&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=b2a89d6203584406a6a215144e4dee65 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:14.400988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.516337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1722-14e2-4648-93f4-4e5a3805675b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.526814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:14.557618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.558638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.558924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.559423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.561119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.562639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.564400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 114/227] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:14.570751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.649404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d38e-99d5-43d2-8007-fa159e126f4a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.661001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:14.689077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.690224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.690691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.691146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.703455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:14.712641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:14.713554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:14.714392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:14.716857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 114/228] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:14.730629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.761711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360797-db88-4799-83d1-e95e9e48df00 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.794707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.795541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.795953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.796232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.797508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.799103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.805584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 115/229] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:14.807969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:14.857948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:14.915566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379b680-c5a5-4376-b2d6-ca27bdae00ef None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.916118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352347-c810-4239-972b-ad95e0646c11 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:14.952308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.953491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.953981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.954437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.955291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:14.955666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:14.956151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.956298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:14.956731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:14.957077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/b0c83d4a1faa4f23add252147c77a62e/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:14.958938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.960179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, user_id=b0c83d4a1faa4f23add252147c77a62e, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:14.962493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:14.968552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 115/230] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:14.978880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:15.008930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:15.043973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 116/231] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:14 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/b0c83d4a1faa4f23add252147c77a62e/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:15.112154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1605af-f041-4d5a-9429-a5e24c97485d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:15.165755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:15.166786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:15.167076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:15.167349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:15.168710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:15.170249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:15.172212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 116/232] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:14 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:15.178786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:15.324232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:15.331087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c87afd-4b65-46f3-9dec-01f8263fa35a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:15.375091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:15.376307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:15.376792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:15.377267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:15.378703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:15.381135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250c09f-a4eb-4455-aa74-f25be6131946 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:15.383147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 117/233] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:15 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:15.389372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:15.489086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:15.500195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130135-0996-4627-94de-90e34cb9a8f0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:15.541698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:15.542629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:15.542907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:15.543180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/b0c83d4a1faa4f23add252147c77a62e/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:15.545435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, user_id=b0c83d4a1faa4f23add252147c77a62e, role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:15.546920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a23fe-36c3-4b5d-b2cd-f968a06defb9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:15.671939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 117/234] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:15 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/b0c83d4a1faa4f23add252147c77a62e/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:16.158518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc96-b376-451e-8852-63c5411a868c None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.159060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc96-b376-451e-8852-63c5411a868c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.159060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accc96-b376-451e-8852-63c5411a868c None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.160573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 118/235] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:16.166093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.166541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.166738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.190690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:16.191920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:16.266090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e818aa-2b14-44a3-b266-58c9fb192625 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.266404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e818aa-2b14-44a3-b266-58c9fb192625 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.266652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e818aa-2b14-44a3-b266-58c9fb192625 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.268159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 119/236] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:16.269743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 118/237] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:16.284366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924407-7f84-4a06-a144-b3127829b343 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.284659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924407-7f84-4a06-a144-b3127829b343 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.284950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924407-7f84-4a06-a144-b3127829b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.313834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-86924407-7f84-4a06-a144-b3127829b343 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:16.315062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-86924407-7f84-4a06-a144-b3127829b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:16.320244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:16.441894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 120/238] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:16.457481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:16.478423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86924407-7f84-4a06-a144-b3127829b343 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:16.490309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f6ed-e146-4389-9d6e-946b8d15a106 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:16.556185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:16.557007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.557289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.557574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.561606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:16.563071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:16.564722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 119/239] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:16.572743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:16.649363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:16.666428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86924407-7f84-4a06-a144-b3127829b343 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:16.756630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a27a-2640-4399-93bb-4ec479a4ae5e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:16.762279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:16.763165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.763462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.763742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.790631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:16.798602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:16.799553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:16.801115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 121/240] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:16.806364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:16.816875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:16.818221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.818421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.819197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.819928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:16.822260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66358fd8-f104-443f-977d-7a7f1f241755 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:16.917731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 120/241] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:16 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:16.921206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b94f-b62d-44ab-aef4-2df65e325646 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.921727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b94f-b62d-44ab-aef4-2df65e325646 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.922006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b94f-b62d-44ab-aef4-2df65e325646 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.931047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 121/242] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:16.933284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:16.933586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:16.933865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:16.936236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e824003-624d-4e8b-8060-5aa0ed81c6bc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:16.965856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:16.967074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:16.969607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.008565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.009168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.009482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.009748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.010765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:17.011075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.012542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.027655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 122/243] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:17.034114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.064163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.102344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 122/244] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:17.149190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.176084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359030-2b87-4e77-8b70-fd131fe768e6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.210749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.211639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.211919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.212193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] PATH_INFO: `/v3/users/77e0799e0dec4b24a352227eddd07cba` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.229710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] RBAC: Authorizing `identity:get_user(user_id=77e0799e0dec4b24a352227eddd07cba)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.231204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.233044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 123/245] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/users/77e0799e0dec4b24a352227eddd07cba => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:17.238752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.275005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74dc5-3bf6-4615-8c0b-bf4c29013dbd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.311782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.324830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.325937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.326406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.326867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.335436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.341173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:17.346900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895faa-6756-4297-949b-75ac84e29a37 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:17.348278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:17.349842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:17.350630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:17.357607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 123/246] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:17.362885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.403941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.404610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.404898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.405177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.488552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.495001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.496018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f052a7-25f1-4f99-bf0b-d4cc500feb39 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.533506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.534169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.534462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.534747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.535509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:17.535861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.537296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.547626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 124/247] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:17.555558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.572882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.610900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 124/248] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:17.616432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.637922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.691914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009cfa-1f33-4455-b9ef-826640fa2f25 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.739442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.740437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.740720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.740993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] PATH_INFO: `/v3/users/0644936993854204b388342ae5ae6975` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.742857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] RBAC: Authorizing `identity:get_user(user_id=0644936993854204b388342ae5ae6975)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.744606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.746845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 125/249] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/users/0644936993854204b388342ae5ae6975 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:17.755388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.762067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9fa3e-4283-4c36-a1a8-c8ae91933e3d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.801227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.803141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.803610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.804023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.805486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.807511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.809943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 125/250] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:17.816170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:17.865234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:17.931028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ae2b2-b727-486e-8cfe-c3a4de2f989e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:17.974073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:17.974779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.975237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.975557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.976406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=77e0799e0dec4b24a352227eddd07cba) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:17.976722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:17.978238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57425-c406-4805-8b00-7c0fd92d8cbb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:17.992604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 126/251] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/role_assignments?user.id=77e0799e0dec4b24a352227eddd07cba&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=7e0c008a59304807a40545334472eec7 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:17.997587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91171-10f8-47a1-8186-361ab67127b9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:17.997587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91171-10f8-47a1-8186-361ab67127b9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:17.997587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91171-10f8-47a1-8186-361ab67127b9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:17.997587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 127/252] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:18.001136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.001435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.001808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.017596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae77c9-2a12-4425-af11-b084664d8518 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:18.050600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:18.057680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:18.062879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:18.079441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:18.081395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.081897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.082365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.084661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:18.086807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:18.088739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 126/253] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:17 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:18.094803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.261218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 128/254] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:18.288738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.307767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1198be7-0301-4a4f-b2d2-591591e13593 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:18.338531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:18.390313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:18.391238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.391527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.391814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/0644936993854204b388342ae5ae6975/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.402463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, user_id=0644936993854204b388342ae5ae6975, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:18.403944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b64c0-1b9b-437c-a334-c6df695898b7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:18.421662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07c7cd-5ddf-4148-b562-cacbf21c6426 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:18.458044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:18.459086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.459387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.459669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.471316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9dc2cd02-db23-43b3-92fe-7b02a99f0746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:18.480204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:18.481101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:18.481905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:18.485769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 129/255] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:18.487146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be549-2202-4ab7-85b7-e822f2027454 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.487455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be549-2202-4ab7-85b7-e822f2027454 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.487789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be549-2202-4ab7-85b7-e822f2027454 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.489921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 130/256] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:18.494237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be549-2202-4ab7-85b7-e822f2027454 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.504961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 127/257] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:18 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/0644936993854204b388342ae5ae6975/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:18.506444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.506734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.507074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.542761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:18.544043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:18.662058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:18.676139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be549-2202-4ab7-85b7-e822f2027454 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:18.717060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:18.717888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.718178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.718459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.719219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:18.719530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:18.720940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:18.722750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:18.735874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 131/258] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:18.737528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.755890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 128/259] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:18.811947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.892504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c6d4-2b15-499c-91e8-9d8663121340 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:18.934994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:18.936456 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:18.937090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:18.937633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:18.939089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:18.940755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:18.948620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 132/260] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:18 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:18.952249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:18.986556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:19.029763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0e557-89c4-4280-95d8-4d9681bd00a0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.092702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284f501-7ba8-4e35-9b2f-ab336cbc13f8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.112630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.113490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.113960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.114159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.139223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.140483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.140975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.141473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.142598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:19.162862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:19.163824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:19.164705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:19.166443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 129/261] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:19.173799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:19.226642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:19.228505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:19.258294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:19.326563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:19.355541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 133/262] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:03:19.362357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:19.472129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb1fd-1692-41cb-9dc6-cff5d6ce793b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.500484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:19.513367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.514812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.515308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.515810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.517257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:19.519165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:19.521278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 134/263] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:19 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:19.527826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:19.559720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00772-43b2-47e0-8fc0-1f62bd52d605 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.642993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092ac2-8776-4b33-8f8b-9b4734528f55 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.666867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.667565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.667855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.668135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.669025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:19.669600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:19.671305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:19.682248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.683364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.683852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.684327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.685372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=b0c83d4a1faa4f23add252147c77a62e) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:19.685933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:19.687605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:19.689330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 130/264] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:19.695112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:19.696519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 135/265] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:19 2022] GET /identity/v3/role_assignments?user.id=b0c83d4a1faa4f23add252147c77a62e&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:19.837739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb88b-6db0-4427-bddd-da28cc7d0c3f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:19.848045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:19.878159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:19.879071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:19.879417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:19.879732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] PATH_INFO: `/v3/users/b0c83d4a1faa4f23add252147c77a62e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:19.881105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c83d4a1faa4f23add252147c77a62e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:19.882682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:19.885123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 131/266] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:19 2022] GET /identity/v3/users/b0c83d4a1faa4f23add252147c77a62e => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:19.890501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:19.985955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:20.034915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0d14-6ec8-49c2-9b5b-4423b99db565 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:20.071902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:20.072812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.073245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.073701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.149336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:20.151063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:20.208988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:20.255543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 136/267] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:20.262640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:20.407260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6a21-e5d3-4b3f-ba87-f36cc749a607 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:20.450620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:20.451499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.451783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.452060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.453290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:20.454867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4496e29-6b72-4be8-9701-abc0f09a51d0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:20.456914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 132/268] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:20 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:20.462665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:20.483758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959e166-efaa-4973-abe1-1fafdc285ff9 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.484200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959e166-efaa-4973-abe1-1fafdc285ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.484303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959e166-efaa-4973-abe1-1fafdc285ff9 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.485666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 133/269] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:20.491664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.492018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.492366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.510611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:20.512254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:20.564890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:20.596458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 134/270] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:20.616096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c18c1-1155-41b4-8924-d432f509403f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:20.624269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:20.662245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:20.663145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.663583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.664063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.665082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=b0c83d4a1faa4f23add252147c77a62e) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:20.665593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:20.667294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbed1c-592a-4858-9221-f242df20b470 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:20.673937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 137/271] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:20 2022] GET /identity/v3/role_assignments?user.id=b0c83d4a1faa4f23add252147c77a62e&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:20.675689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac153c-93ea-41c1-bc92-5bd349d3f540 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.677060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac153c-93ea-41c1-bc92-5bd349d3f540 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.677761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac153c-93ea-41c1-bc92-5bd349d3f540 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.679349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 138/272] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:20.685603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.685941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.688335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.718755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:20.720398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:20.748288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6bdd-bfd5-422d-8e7a-3693a2aac6a6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:20.757980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:20.803913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:20.804745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:20.805018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:20.805291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:20.829117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:20.838584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:20.839560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:20.841023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 135/273] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:20.845839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:20.872465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 139/274] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:20.889919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:20.906122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:20.970639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e342279-cb0b-4b7f-8818-b230c5bd9a82 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.009014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.010004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.010292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.010574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.011400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:21.011710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.013300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.023482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 136/275] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:21.028583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.045457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811f9c-93a0-48f5-8bd6-61eec16cff2e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.080824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.081644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.081932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.082210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.084148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.085469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a53e63-94d0-4be4-98d4-84a02e682b2d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.087372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 140/276] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:21.088346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8fed-a471-49ed-b5c0-36f233b80c72 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.088632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8fed-a471-49ed-b5c0-36f233b80c72 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.088906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8fed-a471-49ed-b5c0-36f233b80c72 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.090343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 141/277] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:21.094868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8fed-a471-49ed-b5c0-36f233b80c72 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.116053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.143668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.150271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca77e2-446d-4dfc-ba12-4cffcc8f1ee7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.185525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.186942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.187597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.188090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] PATH_INFO: `/v3/users/b009b9ecb0bf430aadad265af84cdd59` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.202171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] RBAC: Authorizing `identity:get_user(user_id=b009b9ecb0bf430aadad265af84cdd59)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.203643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc263c1-e887-4845-8118-2c76c52f64ba None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.205511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 137/278] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/users/b009b9ecb0bf430aadad265af84cdd59 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:21.205640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8fed-a471-49ed-b5c0-36f233b80c72 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.211231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.211740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.212201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.232314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:21.233429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:21.242602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.243423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.243601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.243836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.244544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.246095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.305268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 138/279] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:21.306260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.362129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 142/280] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:21 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:21.362910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.428195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.453097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6787d-b6f3-4468-be19-9201768d1b6f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.455606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.484243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924f5b-dcec-4d6b-a79e-d65cfcda92ce None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.507760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.509065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.509532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.510258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.511853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, user.id=b009b9ecb0bf430aadad265af84cdd59, scope.system=all) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:21.512672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.515282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.521462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 139/281] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/role_assignments?user.id=b009b9ecb0bf430aadad265af84cdd59&scope.system=all&role.id=b2a89d6203584406a6a215144e4dee65 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:21.526977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.528044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.533154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.533154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.545277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:21.554688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:21.555843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:21.556836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:21.560175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 143/282] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:21.567918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.691441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cccb36-05da-4f57-a0be-7529fb5a88fd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.732048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.732702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.732981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.733254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.734048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:21.734420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.735759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec50f-d0bc-4e5b-a5dc-60a705d5c5f4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.745455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 140/283] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:21.750895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.817497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8fb6-89c1-41c7-93e5-0b7aa13579b5 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.817978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8fb6-89c1-41c7-93e5-0b7aa13579b5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.818171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd8fb6-89c1-41c7-93e5-0b7aa13579b5 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.819862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 141/284] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:21.825793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.825793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.826114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.843590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:21.844962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:21.849024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.870712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b073-5a99-44e2-9662-ffef5a0396cd None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:21.915744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:21.917163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:21.917868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:21.918679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] PATH_INFO: `/v3/users/77e0799e0dec4b24a352227eddd07cba` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:21.920363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] RBAC: Authorizing `identity:get_user(user_id=77e0799e0dec4b24a352227eddd07cba)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:21.922528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:21.925515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 144/285] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/users/77e0799e0dec4b24a352227eddd07cba => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:21.931218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:21.934877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:21.936196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 142/286] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:21.961208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:22.042612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac00959-21a9-4eef-b947-c68400953169 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.071298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5a8c-2e5c-4ea1-b0aa-7f81ec320fbd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.078235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.079351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.079851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.080310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.081735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:22.084091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:22.086336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 145/287] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:22.092210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:22.110273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.111196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.111489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.111759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.124563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:22.133013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:22.133955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:22.134985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:22.137961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:22.139390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 143/288] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:22.140673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:22.171690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:22.214163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae451ab-9667-42a7-a822-4b3fc234bf78 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.265394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65bafc-b5f0-4761-a2ab-87649fa46e62 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.315647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.316337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.316647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.316931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.319924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:22.320286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:22.321661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:22.324970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.325957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.326249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.326531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/77e0799e0dec4b24a352227eddd07cba/roles/7e0c008a59304807a40545334472eec7` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.332706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, user_id=77e0799e0dec4b24a352227eddd07cba, role_id=7e0c008a59304807a40545334472eec7)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:22.334939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:22.341001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 144/289] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:22.349774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:22.401891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 146/290] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:03:22 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/users/77e0799e0dec4b24a352227eddd07cba/roles/7e0c008a59304807a40545334472eec7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:22.428164 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:22.471750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517fd3-386b-4183-9084-8472f3d3bb27 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.520498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.521421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.521742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.522024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] PATH_INFO: `/v3/users/0644936993854204b388342ae5ae6975` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.523397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] RBAC: Authorizing `identity:get_user(user_id=0644936993854204b388342ae5ae6975)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:22.524948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:22.527055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 145/291] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:22 2022] GET /identity/v3/users/0644936993854204b388342ae5ae6975 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:22.533311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:22.663926 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8fe8-3d8d-41e9-ad1a-79abe27e09a9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:22.694008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:22.700139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:22.700847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:22.701132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:22.701408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:22.786046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:22.787579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:22.918653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 147/292] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:22.925441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:23.051857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2697e-95e2-4da5-bfa3-0f92bf35e730 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:23.081268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:23.091992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:23.092767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:23.093049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:23.093328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:23.094606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:23.096053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279faee1-a7c1-4c1f-b2d2-3f2264a69617 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:23.098519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 146/293] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:22 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:23.106729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:23.156966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:23.236687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a721-9806-4ddf-8943-9c868c0f4afe None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:23.287740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:23.288406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:23.288690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:23.288968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:23.289836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=0644936993854204b388342ae5ae6975) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:23.290146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:23.291585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c1dfe-e421-4ecb-a30d-1a201339305b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:23.303740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 148/294] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:23 2022] GET /identity/v3/role_assignments?user.id=0644936993854204b388342ae5ae6975&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=b2a89d6203584406a6a215144e4dee65 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:23.977325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaae3-bc52-468b-ad0e-7a7785f24fab None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:23.978380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaae3-bc52-468b-ad0e-7a7785f24fab None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:23.978875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaae3-bc52-468b-ad0e-7a7785f24fab None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:23.980715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 147/295] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:23.985667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f0a8-bf50-4352-aa89-b171b9263897 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:23.986068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f0a8-bf50-4352-aa89-b171b9263897 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:23.986235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f0a8-bf50-4352-aa89-b171b9263897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.003115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6823f0a8-bf50-4352-aa89-b171b9263897 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:24.004404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6823f0a8-bf50-4352-aa89-b171b9263897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:24.079666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 149/296] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:24.105596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaae3-bc52-468b-ad0e-7a7785f24fab None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.213878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaae3-bc52-468b-ad0e-7a7785f24fab None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.235853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e1b7-c4c6-40f0-abb9-7d7217b29aac None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.236461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e1b7-c4c6-40f0-abb9-7d7217b29aac None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.236940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e1b7-c4c6-40f0-abb9-7d7217b29aac None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.239376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 150/297] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:24.243294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ad14-aec2-4c04-8805-5f03bccf6c97 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.243294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ad14-aec2-4c04-8805-5f03bccf6c97 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.243294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ad14-aec2-4c04-8805-5f03bccf6c97 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.244369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 151/298] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:24.245699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.245699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.245960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.254327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.255358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.255642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.255919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.263296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:24.264491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:24.268584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3951ef56-0031-49c1-890d-f50de2da36f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:24.277615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:24.278710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:24.279680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 148/299] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:24.280475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.285158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.285158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.292082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.299464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:24.300764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:24.357723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 152/300] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:24.358838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.362853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.384357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 149/301] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:24.385726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.465006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae2f0e-c6e7-432d-81b7-7f42ed44ec2f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.500579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.501176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.501464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.501773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.502639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:24.502858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4a6d8-df4f-4940-ba2f-987d048ae633 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.502956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.504897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.513851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 153/302] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:24.514442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.535062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.547137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.547990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.548273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.548566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.560527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:24.568626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:24.569586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 150/303] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:24.570814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.630167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.636611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5e0d-3807-490c-be7b-754e4bdddad7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.673163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.674056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.674601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.674601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.675723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.677721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.684622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 154/304] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:24.684622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.699145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10595-dcdb-46c0-9ff9-9a177a954a79 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.736145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.737027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.737311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.737611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] PATH_INFO: `/v3/users/b009b9ecb0bf430aadad265af84cdd59` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.739312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] RBAC: Authorizing `identity:get_user(user_id=b009b9ecb0bf430aadad265af84cdd59)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.740782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.742467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 151/305] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/users/b009b9ecb0bf430aadad265af84cdd59 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:24.747722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.778642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.797906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2af87-47c4-4a04-886b-e10080a2343f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.833268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a97374-466a-479a-8652-74224f329463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.834001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97374-466a-479a-8652-74224f329463 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.834280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97374-466a-479a-8652-74224f329463 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.834553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97374-466a-479a-8652-74224f329463 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.835303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a97374-466a-479a-8652-74224f329463 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:24.835606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a97374-466a-479a-8652-74224f329463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.836971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a97374-466a-479a-8652-74224f329463 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.844968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 155/306] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:24.845949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a97374-466a-479a-8652-74224f329463 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:24.854785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709290b-760e-422f-836a-94b86a27bdec None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.871676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:24.890145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.890818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.891101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.891397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] PATH_INFO: `/v3/groups` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.892067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.893499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856689a7-65a6-49c4-9e32-63b61bb240ae None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.945929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a97374-466a-479a-8652-74224f329463 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:24.978179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:24.979061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.979349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.979629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] PATH_INFO: `/v3/system/users/b009b9ecb0bf430aadad265af84cdd59/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.981117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b009b9ecb0bf430aadad265af84cdd59, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:24.982524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7733dd-cf1d-45b5-904d-392c58cf2ae6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:24.992045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 152/307] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 21 09:03:24 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:24.993405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52cbe-bcf6-4b3f-908e-8f900defe32c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:24.993729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52cbe-bcf6-4b3f-908e-8f900defe32c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:24.994007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52cbe-bcf6-4b3f-908e-8f900defe32c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:24.995238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 153/308] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:24.998532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52cbe-bcf6-4b3f-908e-8f900defe32c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.072387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 156/309] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 21 09:03:24 2022] PUT /identity/v3/system/users/b009b9ecb0bf430aadad265af84cdd59/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:25.074403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.074696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.074973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.094217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:25.095513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:25.100781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:25.161041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52cbe-bcf6-4b3f-908e-8f900defe32c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.203583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 157/310] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:25.214455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.215584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.215740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.216118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] PATH_INFO: `/v3/users/d4b0f5e5cceb48929b0e223cdce316a5` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.229630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.234087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] RBAC: Authorizing `identity:get_user(user_id=d4b0f5e5cceb48929b0e223cdce316a5)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:25.238541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:25.238541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 154/311] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:24 2022] GET /identity/v3/users/d4b0f5e5cceb48929b0e223cdce316a5 => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:25.243923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.291228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:25.342680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb10d-fcd3-449b-b3a7-23f30a9b895a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.371546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4bdd6-5cce-48a2-8d98-9addcd366036 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.379017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.380115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.380475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.380865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.391999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:25.401073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:25.402055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:25.403078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 158/312] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:25.406043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:25.408528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.417047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.417961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.418444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.418858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.420072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, user.id=d4b0f5e5cceb48929b0e223cdce316a5, scope.system=all) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:25.421029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:25.423106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:25.430670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 155/313] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 21 09:03:25 2022] GET /identity/v3/role_assignments?user.id=d4b0f5e5cceb48929b0e223cdce316a5&scope.system=all&role.id=7e0c008a59304807a40545334472eec7 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:25.530949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd27d5-ae7d-4c89-a076-9a71b21a8ebf None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.569702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.570403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.570692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.570972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.571747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:25.572060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:25.573595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:25.584608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 159/314] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:25.590812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.701591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:25.706313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d4a95-a907-4bd9-9e65-286a0bee971d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.743551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.744732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.745194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.745677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] PATH_INFO: `/v3/users/77e0799e0dec4b24a352227eddd07cba` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.747106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=77e0799e0dec4b24a352227eddd07cba)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:25.748999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:25.751171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 156/315] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:25 2022] GET /identity/v3/users/77e0799e0dec4b24a352227eddd07cba => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:25.757361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:25.827720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:25.865694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee893-d14c-4843-b31e-2dc92623750a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:25.904622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:25.905287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:25.905585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:25.905869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:25.976872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:25.978284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:26.042067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:26.083111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 160/316] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:26.088351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:26.196005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aa96-1935-418e-b7bd-452c90775eb5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:26.235006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:26.235794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:26.236077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:26.236352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:26.237554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:26.239578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5488f-ecf8-4a03-9d49-9a25a352e954 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:26.245936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 157/317] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:26 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:26.247888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:26.358561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84867e-c55a-4eb4-832b-772d77b044b9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:26.394052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:26.395372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:26.395803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:26.396082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:26.396906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e, user.id=77e0799e0dec4b24a352227eddd07cba) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:26.397218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:26.398676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5f19f-37bd-4a1c-9722-7d4e53411ef2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:26.404870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 161/318] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:26 2022] GET /identity/v3/role_assignments?user.id=77e0799e0dec4b24a352227eddd07cba&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=7e0c008a59304807a40545334472eec7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:27.172637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95422402-0bb3-4abd-bb22-fc4251ba0b7a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.173154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95422402-0bb3-4abd-bb22-fc4251ba0b7a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.173263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95422402-0bb3-4abd-bb22-fc4251ba0b7a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.174623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 158/319] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:27.180060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.180487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.180661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.197913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:27.199104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:27.219965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.255324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c90ba-f06a-4e51-8c4b-4f9d14dee2b4 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.255621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c90ba-f06a-4e51-8c4b-4f9d14dee2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.255940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c90ba-f06a-4e51-8c4b-4f9d14dee2b4 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.257240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 159/320] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:27.262703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.263066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.263408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.278731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 162/321] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:27.280181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:27.281367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:27.310079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.323695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.354063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 160/322] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:27.377154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.458945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480bb36-976f-4ddd-99ae-e683caa03383 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.495893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.496706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.496991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.497269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.498468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:27.499921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe189-7db2-4a8e-b17a-d7078fbb19fd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:27.501181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e4d34-92dc-425d-ae78-165dbb342158 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.501602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 163/323] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:27.508088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78449a-61d0-4974-9833-7f4fb38b08e9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.508372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78449a-61d0-4974-9833-7f4fb38b08e9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.508653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78449a-61d0-4974-9833-7f4fb38b08e9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.510249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 164/324] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:27.510928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78449a-61d0-4974-9833-7f4fb38b08e9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.536706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.537958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.538799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.539094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.539373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.549612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6bf6238a-714f-46e5-a223-bd44ca90b454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:27.558233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:27.559441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:27.560391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 161/325] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:27.561076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.561076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.561216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.578171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:27.579357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:27.596757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.616370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78449a-61d0-4974-9833-7f4fb38b08e9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.646560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 162/326] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:27.647394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.650092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.650750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.651033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.651305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] PATH_INFO: `/v3/groups` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.651986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:27.653418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:27.733681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 165/327] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 21 09:03:27 2022] POST /identity/v3/groups => generated 226 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:27.733681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.755227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980fba-357f-41e7-b7fe-0164b76f63fc None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.795656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.796437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.796795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.797066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.797859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:27.798167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:27.799599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:27.810487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 163/328] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:27.816082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.837588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.848353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:27.855440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18030a5-1ca5-429d-978c-31a2ba160b82 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.897759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.898399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.898686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.898996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.911038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:27.918896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:27.919825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:27.920600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 166/329] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:27.928411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:27.948167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3a86-ae0a-4a3c-a7b1-769d1547db91 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:27.992464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:27.993279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:27.993578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:27.993870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] PATH_INFO: `/v3/users/b009b9ecb0bf430aadad265af84cdd59` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:27.995584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] RBAC: Authorizing `identity:get_user(user_id=b009b9ecb0bf430aadad265af84cdd59)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:27.997320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:27.999175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 164/330] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/users/b009b9ecb0bf430aadad265af84cdd59 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:28.005525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:28.053450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37004-bc71-47be-a939-39726a87d1b8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:28.099034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:28.099714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:28.100003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:28.100774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:28.101149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:28.101491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:28.103103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:28.114860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 167/331] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:28.115069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:28.122650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:28.134030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77104-e698-4037-8f8c-f124b549b889 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:28.139564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:28.182435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:28.183161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:28.183440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:28.183711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:28.184567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] RBAC: Adding query filter params (role.id=b2a89d6203584406a6a215144e4dee65, user.id=b009b9ecb0bf430aadad265af84cdd59, scope.system=all) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:28.184878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:28.186377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:28.208659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 165/332] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 21 09:03:28 2022] GET /identity/v3/role_assignments?user.id=b009b9ecb0bf430aadad265af84cdd59&scope.system=all&role.id=b2a89d6203584406a6a215144e4dee65 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:28.265598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdec7-35aa-484f-8331-bd711c1ad046 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:28.313959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:28.314875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:28.315165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:28.315446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] PATH_INFO: `/v3/users/d4b0f5e5cceb48929b0e223cdce316a5` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:28.316822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] RBAC: Authorizing `identity:get_user(user_id=d4b0f5e5cceb48929b0e223cdce316a5)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:28.318436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8bdf8-0b98-4f16-9194-fe9d1775ba00 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:28.320370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 168/333] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:28 2022] GET /identity/v3/users/d4b0f5e5cceb48929b0e223cdce316a5 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:28.326971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:28.464958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaa5f2-50ee-466b-929c-c634ae153f35 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:28.507561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:28.508477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:28.508764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:28.509044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] PATH_INFO: `/v3/system/users/d4b0f5e5cceb48929b0e223cdce316a5/roles/7e0c008a59304807a40545334472eec7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:28.511022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d4b0f5e5cceb48929b0e223cdce316a5, role_id=7e0c008a59304807a40545334472eec7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:28.512410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee06172-688d-46d1-b012-ef1b21e793e5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:28.589321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 166/334] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 21 09:03:28 2022] PUT /identity/v3/system/users/d4b0f5e5cceb48929b0e223cdce316a5/roles/7e0c008a59304807a40545334472eec7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:30.237208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c55-2533-4e38-b5d6-c71cec81d837 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.237738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c55-2533-4e38-b5d6-c71cec81d837 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.237894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c55-2533-4e38-b5d6-c71cec81d837 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.240057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 169/335] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:30.248215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.248703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.248779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.264742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:30.272868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:30.274085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:30.364602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 167/336] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:30.405127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a83c55-2533-4e38-b5d6-c71cec81d837 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:30.516367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:30.553404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a83c55-2533-4e38-b5d6-c71cec81d837 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:30.606278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:30.607423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.607880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.608321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.622448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-48f3da61-cc19-484a-80f4-91d8bc30a96b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:30.630484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:30.631644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:30.633115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:30.642077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 170/337] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:30.648736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:30.704092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884152-2a08-486b-bc22-3de59a0f1778 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.704382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884152-2a08-486b-bc22-3de59a0f1778 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.704664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884152-2a08-486b-bc22-3de59a0f1778 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.708848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 171/338] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:30.710527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051dd5-3c15-49d0-9bc5-c28ce3744be0 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.711050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051dd5-3c15-49d0-9bc5-c28ce3744be0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.717757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051dd5-3c15-49d0-9bc5-c28ce3744be0 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.719441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 172/339] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:30.720908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.721400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.721884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.770717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:30.772282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:30.791278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b49ec-3651-4a27-b86e-52ce34cda2ff None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:30.844158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:30.845420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.845868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.846280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.847286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:30.847932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:30.849685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfad91-b064-49e3-9f59-f6fe44acb9b0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:30.867299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 168/340] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:30.868646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:30.868945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:30.869234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:30.870862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:30.914999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:30.916210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:30.948501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 173/341] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:30.949379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.064099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 169/342] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:31.065381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.085354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:31.140483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc52dc-4af0-4b82-b036-f64e6c1ee722 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.188693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:31.188693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.188693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.189035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.290730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46974a-4af9-4ccb-acf5-dda4401edb93 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.313591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:31.315173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:31.341051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:31.356167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:31.358556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.358556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.358556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.379790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:31.391713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:31.392678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:31.393504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:31.395355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 170/343] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:31.397742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.427570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:31.500058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 174/344] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:31.501151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.625669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84f339-bf6d-4217-afe4-8fdfed6850aa None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.706363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46937e7a-cad5-4183-bbba-08d324dc0e94 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.706700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:31.707839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.707839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.708165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.732799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:31.741635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:31.742672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:31.743554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:31.746152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 171/345] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:31.747168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.752584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:31.753216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.753550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.753867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.756119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:31.756303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:31.760514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc51b-bd82-4754-bda7-5d7e2ffe91d3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:31.772161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 175/346] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:31.774487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda15d-c30d-44cc-ac68-17086cfb6320 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.774778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda15d-c30d-44cc-ac68-17086cfb6320 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.775066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda15d-c30d-44cc-ac68-17086cfb6320 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.777686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 176/347] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:31.778655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda15d-c30d-44cc-ac68-17086cfb6320 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:31.813431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:31.839252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:31.918835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd317084-1f1e-48d5-ba66-b2fbede878cb None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.951090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda15d-c30d-44cc-ac68-17086cfb6320 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:31.976611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:31.977582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:31.977930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:31.978207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:31.979444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:31.981091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:31.983153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 172/348] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:31.983937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.004204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.004888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.005170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.005440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.006228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:32.006532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.007914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ce14-e1af-441e-b371-c6b78ebf0756 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.018101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 177/349] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:32.020480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d92b6-636b-4a43-ab06-551245668351 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.020771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d92b6-636b-4a43-ab06-551245668351 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.021044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d92b6-636b-4a43-ab06-551245668351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.042144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-935d92b6-636b-4a43-ab06-551245668351 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:32.043459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-935d92b6-636b-4a43-ab06-551245668351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:32.117199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7a1a9-ec91-4985-abc1-675f1b31a4e9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.119521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 178/350] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:32.121266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d92b6-636b-4a43-ab06-551245668351 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.144662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.146938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.169391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.170490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.171035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.171514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.236233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d92b6-636b-4a43-ab06-551245668351 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.280999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.281949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.282230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.282507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.285676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.288413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8562223-403e-4291-a0c1-fc144c12a75c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.291560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.293604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.295710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 179/351] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:32.296644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.431495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.452579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 173/352] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:32.454005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6dca-bee8-4178-a715-04ec3f8c8b96 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.454294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6dca-bee8-4178-a715-04ec3f8c8b96 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.454560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb6dca-bee8-4178-a715-04ec3f8c8b96 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.455838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 174/353] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:32.457415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6dca-bee8-4178-a715-04ec3f8c8b96 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.466039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a915-8fe7-40fd-a810-bcd49d2332dc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.483909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.515397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.516067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.516357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.516634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.598337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb6dca-bee8-4178-a715-04ec3f8c8b96 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.603439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.604633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.645851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.646657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.647786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.647786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.661603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:32.669493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:32.671387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 175/354] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:32.672190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.722824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.749609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 180/355] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:32.750223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.770444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:32.798122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656b28-e9e3-4ffd-827d-03dc3ddd572a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.841691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.842355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.842638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.842915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.843759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:32.844062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.845520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459a80d-b8b1-428c-9f85-faaf25425914 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.855495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 176/356] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=b2a89d6203584406a6a215144e4dee65 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:32.857016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.857506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.858022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.880575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:32.882570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:32.893971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258667-3777-4a85-969c-3ee777be4d14 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:32.938265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:32.939579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.939579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.939870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.941869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:32.943365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2eab09-885b-4ad5-86a1-4910d58f31d3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:32.945669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 181/357] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:32.946844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba7d4-0d45-4f9a-b0dd-6ab535c3d84d None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:32.947131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba7d4-0d45-4f9a-b0dd-6ab535c3d84d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:32.947468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfba7d4-0d45-4f9a-b0dd-6ab535c3d84d None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:32.949604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 182/358] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:32.949604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba7d4-0d45-4f9a-b0dd-6ab535c3d84d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:32.994609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 177/359] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:32.996095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.034571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.097703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfba7d4-0d45-4f9a-b0dd-6ab535c3d84d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.112331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.148462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.149157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.149441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.149776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.150527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:33.150838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:33.152239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a439798-ee6d-4144-9695-66117d775161 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:33.164511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41898bf-adb7-4d20-a57d-5879b6a087ab None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.169482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 183/360] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:33.171051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.171567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.172060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.193412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:33.195013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:33.224267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.225253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.225543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.225869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.227676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:33.229359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:33.231605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 178/361] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:32 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:33.232563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.287375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 184/362] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:33.288189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.349689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.367341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8308d91-be08-4728-9f59-15a38841e2d5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.430477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.432143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.432573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.433023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.436467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:33.437968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:33.439130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcbd0-ad7f-4a38-814d-08a107a16f78 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.445336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 179/363] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:33.445336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.456946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.495195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.496025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.496304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.496586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.508573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:33.517051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:33.518013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:33.519462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:33.522682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 185/364] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:33.522682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.592743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3087b9-9dc2-4323-86ac-0b3661bc1082 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.662388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.663286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.663567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.663852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] PATH_INFO: `/v3/users/d4b0f5e5cceb48929b0e223cdce316a5` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.665359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] RBAC: Authorizing `identity:get_user(user_id=d4b0f5e5cceb48929b0e223cdce316a5)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:33.667905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:33.669356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 180/365] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/users/d4b0f5e5cceb48929b0e223cdce316a5 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:33.669773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.700377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5cc90-7a34-41e0-956c-729e1565da4f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.703056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.757415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.758649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.760744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.761037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.764795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:33.767828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:33.770618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 186/366] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:33.771409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:33.812509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:33.859369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a91d-9b2e-4463-95f9-d8edf5a05c39 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.939651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:33.940476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:33.942319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:33.942319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:33.958475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:33.960520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5344-73ea-4e0b-b839-c52f413037d0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:33.967892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:33.968859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:33.970197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 181/367] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:33.971081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.031239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.032866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.035045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.037172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.038340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:34.038653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.042042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.049507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 187/368] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:34.057503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.116468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.168235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62855197-6f20-4101-88da-6258c3b63f11 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.233158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.233887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.234061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a787966-ba16-4ff0-aec7-3a0dfd02822b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.234156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.234437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.235217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:34.235527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.236970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.239396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.253656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 182/369] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:34.253656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.283575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.285056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.285354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.285672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.286700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] RBAC: Adding query filter params (role.id=7e0c008a59304807a40545334472eec7, user.id=d4b0f5e5cceb48929b0e223cdce316a5, scope.system=all) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:34.287019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.289164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.310315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 188/370] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/role_assignments?user.id=d4b0f5e5cceb48929b0e223cdce316a5&scope.system=all&role.id=7e0c008a59304807a40545334472eec7 => generated 510 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:34.310315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.391480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ccd7f-a51b-4164-bc73-fc7dfa3e8c8c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.437652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.438335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.438622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.438900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.439754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:34.440070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.441608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.448967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 183/371] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=b2a89d6203584406a6a215144e4dee65 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:34.449617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.533978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.543229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.560567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7837e3-0319-4d63-9cad-ce91d787ba63 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.579758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f36fa8-0e73-41c0-816d-341a4e934571 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.621167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.621895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.622189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.622475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.638974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.639661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.639941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.640214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.640978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:34.641285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.642785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.662233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 189/372] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:34.668217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.716705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.718548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.794630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.794814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756b62-34c6-4c01-9af6-2c5e0c90792b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:34.848360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:34.849049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:34.849443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:34.849633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:34.870861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 184/373] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:34.872121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:34.889287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:34.947826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:34.949722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:34.999682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011893-2afb-400e-b042-f813a212ca6b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.038521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.040860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.040860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.040860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.042017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.043494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.049638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 185/374] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:35.053518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.091775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 190/375] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:35.102792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.136252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:35.170744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:35.220658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38848-63c4-4069-866e-65648ae6752f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.262037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.262969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.263256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.263587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] PATH_INFO: `/v3/projects/97e449c5adf9473b93e84773b7f3aad3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.264986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] RBAC: Authorizing `identity:get_project(project_id=97e449c5adf9473b93e84773b7f3aad3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.267049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.269302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 191/376] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/projects/97e449c5adf9473b93e84773b7f3aad3 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:35.277054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.354735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672f6a1-4da0-470d-8d55-5d5c3e3a79da None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.407264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e0ce-7de3-4fda-b6c8-f4bd0af8d1da None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.423339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.424377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.424493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.424739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.430334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.431827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.434603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 186/377] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:35.439699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.444285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:35.458292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.462322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.462322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.462322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] PATH_INFO: `/v3/groups/2ff37dde1367456aa324d84f8cd2cc49` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.470290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] RBAC: Authorizing `identity:get_group(group_id=2ff37dde1367456aa324d84f8cd2cc49)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.472381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.474765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 192/378] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/groups/2ff37dde1367456aa324d84f8cd2cc49 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:35.480461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.553389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:35.561774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820801-630c-4bb3-8086-1fda4a95e43f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.605213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9800dcd-e89d-4b81-afe6-048bf0e88a9b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.608179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.608837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.609117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.609385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.610253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:35.611332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.611993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3e470-5c32-4991-b637-ae7966e58008 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.619632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 187/379] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:35.620982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0e0f-461b-4e8b-8253-55ddb1847e14 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.621270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0e0f-461b-4e8b-8253-55ddb1847e14 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.621544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0e0f-461b-4e8b-8253-55ddb1847e14 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.627368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 188/380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:35.629210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.629502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.629825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.648615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:35.649893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:35.666026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.667633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.668384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.668872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:35.670190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] RBAC: Adding query filter params (group.id=2ff37dde1367456aa324d84f8cd2cc49, role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=97e449c5adf9473b93e84773b7f3aad3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:35.670725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:35.672643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:35.681014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 193/381] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/role_assignments?group.id=2ff37dde1367456aa324d84f8cd2cc49&scope.project.id=97e449c5adf9473b93e84773b7f3aad3&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:35.796569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 189/382] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:35.820574 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:35.878934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:35.945542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d99d-6fe5-43be-bf45-c07d5f5f3a97 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:35.990514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:35.991346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:35.991633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:35.991912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.006915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:36.015110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:36.016206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:36.017188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:36.018584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 194/383] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:36.024301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:36.136479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:36.151739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5003-eff2-464f-a867-75c06f0c87e6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:36.201205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:36.222810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:36.223225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 190/384] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:36.223292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:36.368141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5889288-7fcb-4bfa-bace-f5fceafef054 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:36.383080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:36.408626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:36.409516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.409833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.410253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.413109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:36.414594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:36.416723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 195/385] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:36 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:36.422829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:36.549412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd57-e537-497b-bfb6-9b54c37ab8d7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:36.589119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:36.590033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.590318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.590593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.594296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:36.595807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3bbd-bf08-4531-9a83-2652ccb5ec41 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:36.598518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 191/386] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:36 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:36.606679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:36.761294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398538c3-85b9-47c6-976c-1aec3c1d6bf6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:36.796913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:36.797822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.798099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.798366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/groups/b1006652c4cf410581f608aea7802200/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.800871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, group_id=b1006652c4cf410581f608aea7802200, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:36.802335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22d06-26e0-4674-9849-655992a65a76 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:36.884842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf831b7-93bd-4a16-a0ad-a0164751617e None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.885175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf831b7-93bd-4a16-a0ad-a0164751617e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.885416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf831b7-93bd-4a16-a0ad-a0164751617e None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.886656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 196/387] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 21 09:03:36 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/groups/b1006652c4cf410581f608aea7802200/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:36.886862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 192/388] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:36.892578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c2f4-7b7b-432e-bfa7-8b29f7f734ab None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:36.894831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c2f4-7b7b-432e-bfa7-8b29f7f734ab None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:36.894831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227c2f4-7b7b-432e-bfa7-8b29f7f734ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:36.921632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0227c2f4-7b7b-432e-bfa7-8b29f7f734ab None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:36.923119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0227c2f4-7b7b-432e-bfa7-8b29f7f734ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:36.968659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:37.027671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 197/389] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:37.064538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf831b7-93bd-4a16-a0ad-a0164751617e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.093346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:37.187909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf831b7-93bd-4a16-a0ad-a0164751617e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.226040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.226863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.227147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.227421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.236563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4387-30bd-4a1f-84d0-7b433ead1b7e None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.236851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4387-30bd-4a1f-84d0-7b433ead1b7e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.237128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b4387-30bd-4a1f-84d0-7b433ead1b7e None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.242861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 198/390] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:37.243898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:37.250925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.251210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.251480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:37.252494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:37.253646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:37.254449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 193/391] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:37.260260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.285958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:37.287264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:37.376140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 199/392] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:37.403566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.479197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:37.516913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f412-dbc5-4a53-aeac-94f1785043ec None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.576461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:37.581597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec83d0-e772-491c-af7b-a8ca4c55e603 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.592153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.592836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.593123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.593400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.594190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:37.594500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:37.595952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:37.611895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 194/393] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:37.618149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.653806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.655791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.656579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.657073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.691317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:37.707735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:37.708810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:37.709644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 200/394] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:37.724594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.737617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df81-0ca0-4e65-a33a-3e82451fd269 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.775578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.776509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.776799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.777081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.778395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:37.779930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:37.782072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 195/395] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:37.788196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.803444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:37.905820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8a45-f767-4354-b05f-589464b9bcda None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.919910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb869d2-67b7-4cfa-a178-185b0e983962 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:37.958318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.959017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.959300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.959572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.960334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:37.960643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:37.962058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:37.970416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:37.971358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:37.972285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:37.972572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:37.973851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:37.975328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:37.977435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 196/396] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:37.977805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 201/397] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:37.983433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:37.986554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.025916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.085663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.110367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e64f-7e59-4af0-9110-e2aae76f8dcf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.148951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.149949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.150233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.150508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/groups/b1006652c4cf410581f608aea7802200/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.152820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] RBAC: Authorizing `identity:create_grant(project_id=36904b7cd7d8459b94f69b2a0f2639ed, group_id=b1006652c4cf410581f608aea7802200, role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:38.154455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006353d3-597f-42b5-966e-009ed19a467e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:38.176783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9b04f-72ed-49a5-aad7-ccc2e6729d6b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.213812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.214715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.215012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.215320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.216529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:38.218080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0537ee-f6e0-4e38-af83-26dba5c3dbcc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:38.220949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 202/398] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:37 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:38.222768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac81fa-a552-4954-aa07-cf72d6b6a9f9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.222768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac81fa-a552-4954-aa07-cf72d6b6a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.222768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac81fa-a552-4954-aa07-cf72d6b6a9f9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.223830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 203/399] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:38.228666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac81fa-a552-4954-aa07-cf72d6b6a9f9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.234303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 197/400] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 21 09:03:37 2022] PUT /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed/groups/b1006652c4cf410581f608aea7802200/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:38.236021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.236511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.237006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.259886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:38.261663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:38.354318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 198/401] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:38.380336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.455343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.473742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.477477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac81fa-a552-4954-aa07-cf72d6b6a9f9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.515411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700275a-2548-4cf5-95e9-47af41ac1685 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.526469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.527830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.528466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.528779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.530480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:38.532599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2601a26-684a-433e-9b62-41ed25da7a64 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:38.536327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 204/402] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:38 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:38.538036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49804df-7121-45f7-904b-9473c90b0cc9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.538438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49804df-7121-45f7-904b-9473c90b0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.538837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49804df-7121-45f7-904b-9473c90b0cc9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.540573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 205/403] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:38.546000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49804df-7121-45f7-904b-9473c90b0cc9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.568079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.569477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.570223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.570508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.586967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-826c736a-8dc1-4be9-b930-dda2646b047b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:38.597477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:38.599026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:38.599832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 199/404] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:38.604842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.604842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.604842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.627020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:38.628543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:38.678467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49804df-7121-45f7-904b-9473c90b0cc9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.716387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.717399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.717811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.718180 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/groups/b1006652c4cf410581f608aea7802200/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.720296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, group_id=b1006652c4cf410581f608aea7802200, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:38.722628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:38.725182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 200/405] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:38.726439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.807806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.840357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 206/406] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 21 09:03:38 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/groups/b1006652c4cf410581f608aea7802200/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:38.841033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:38.884382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:38.887417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3250d-1c20-4f1d-8425-61c43dbd00e7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:38.958900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:38.959591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:38.959872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:38.960148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:38.960980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:38.961284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:38.962865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:38.972928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 201/407] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:38.978426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.063993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2bb17-fc4e-46ea-a86b-51c77f357d9e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.093238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c61f4-99a8-45ce-951f-6d9a84f09761 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.102137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.102953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.103238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.103516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.116193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:39.118079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:39.124880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:39.133865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 207/408] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:39.134702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.135411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.135411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.135411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.135411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.136133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.137582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.139644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 202/409] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:38 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:39.145354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.247725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.251160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce94c-17d3-4034-a7e7-5c45f307dbb9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.287058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.287930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.288208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.288478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.289712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.291162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.293138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 203/410] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:39 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:39.301011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.316726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c868-a83b-4e47-a70f-a6d5db05cda6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.366023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.408709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd6cfb-ed80-4be7-b050-5668a1638a72 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.447074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.447968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.448254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.448534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/groups/b1006652c4cf410581f608aea7802200/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.450901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e, group_id=b1006652c4cf410581f608aea7802200, role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.452602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fe7b1-9dec-48e2-b708-ac3f6aefaf9b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.465847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.466602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.466888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.467165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.468984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:39.468984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.469787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.479983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 208/411] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:39.485413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.525862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 204/412] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 21 09:03:39 2022] PUT /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e/groups/b1006652c4cf410581f608aea7802200/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:03:39.544751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe7d2-490d-47b9-a3b8-e624c1e3a496 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.545801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe7d2-490d-47b9-a3b8-e624c1e3a496 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.545801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfe7d2-490d-47b9-a3b8-e624c1e3a496 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.547818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 205/413] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:39.557870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.558198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.558432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.596216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:39.598332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:39.695720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6bb49-14dd-4e9d-a31c-f5f582cee614 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.724469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 206/414] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:39.742599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.743618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.744001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.744375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] PATH_INFO: `/v3/groups/2ff37dde1367456aa324d84f8cd2cc49` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.745684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] RBAC: Authorizing `identity:get_group(group_id=2ff37dde1367456aa324d84f8cd2cc49)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.747252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.749064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 209/415] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:39 2022] GET /identity/v3/groups/2ff37dde1367456aa324d84f8cd2cc49 => generated 229 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:39.750473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.755275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.764972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.817966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.863616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8faf38-3314-4116-8e7a-dc07a63dfba7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.899083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.900121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.900517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.900891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] PATH_INFO: `/v3/projects/97e449c5adf9473b93e84773b7f3aad3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.902217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] RBAC: Authorizing `identity:get_project(project_id=97e449c5adf9473b93e84773b7f3aad3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:39.903764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:39.905856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 210/416] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:39 2022] GET /identity/v3/projects/97e449c5adf9473b93e84773b7f3aad3 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:39.908274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074d3e1-be01-443e-881c-2596e3c08ac5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:39.917191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:39.970619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:39.972238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:39.972350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:39.972621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:39.998390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:39.999168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:40.007773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:40.008971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:40.010179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:40.015930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 207/417] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:40.022342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:40.029118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dcb15-9bd4-46a3-92a4-6d99ba534733 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:40.064267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:40.066085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.066564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.067051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] PATH_INFO: `/v3/projects/97e449c5adf9473b93e84773b7f3aad3/groups/2ff37dde1367456aa324d84f8cd2cc49/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.069444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] RBAC: Authorizing `identity:create_grant(project_id=97e449c5adf9473b93e84773b7f3aad3, group_id=2ff37dde1367456aa324d84f8cd2cc49, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:40.072275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:40.142398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 211/418] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 21 09:03:39 2022] PUT /identity/v3/projects/97e449c5adf9473b93e84773b7f3aad3/groups/2ff37dde1367456aa324d84f8cd2cc49/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:03:40.161598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b9f0-2c9a-455a-833b-fa78954dab14 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:40.172011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:40.200314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:40.201002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.201288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.201594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.202363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:40.202678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:40.204202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011695a6-aed3-48ea-98b2-7d4b92afe2df None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:40.219744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 208/419] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:40.221337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:40.362677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440fabb-2c49-407f-b8b4-fa277da696bc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:40.402140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:40.402964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.403343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.403723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.406682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:40.478255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:40.479897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:40.586141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 212/420] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:40.587363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9ff0-9b49-4709-ab96-3ccf822eacaf None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.587662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9ff0-9b49-4709-ab96-3ccf822eacaf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.587944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9ff0-9b49-4709-ab96-3ccf822eacaf None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.589390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 209/421] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:40.594839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:40.599640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.600186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.600263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.637663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:40.637834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:40.637834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:40.743552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401a78-3e54-4a53-8dab-5c26509deee2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:40.796611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 210/422] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:40.808032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:40.809268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:40.809809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:40.810296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:40.811696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:40.813379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:40.816384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 213/423] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:40 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:40.822731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:40.828855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:40.953848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:40.958108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df654a-7851-45ec-8d2a-72aa28ba0439 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:40.959944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:40.964929 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1fd87-5f82-4ca1-9d37-a6d83fd68139 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:41.001933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.006582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.007136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.007587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.027404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:41.041167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.042514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.042986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.043425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.046946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:41.048582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:41.049131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:41.050049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:41.050912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:41.054785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 211/424] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:40 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:41.055134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 214/425] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:41.065785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.067491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.260709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a150ac-4a24-438b-a888-0e9a7c15b5bf None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:41.290788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebd396-2f0b-4b86-bb72-00c92561ed71 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:41.299040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.299970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.300439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.300860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.301888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:41.302343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:41.304361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:41.311604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 215/426] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=b2a89d6203584406a6a215144e4dee65 => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:41.384265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.384966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.385249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.385521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.386315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:41.386619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:41.388069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f3962-9731-4bdb-b26c-5328088f29a2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:41.402063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 212/427] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:41.407815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.452587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:41.524233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ab26-1e51-4cf4-8e81-9a866e9718a0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.524844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ab26-1e51-4cf4-8e81-9a866e9718a0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.525353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ab26-1e51-4cf4-8e81-9a866e9718a0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.527426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 213/428] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:41.532684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.535664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.535664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.560582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873849-1252-4143-b855-fa935d1f79bd None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:41.562974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:41.564198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:41.589349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:41.618788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.619900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.620413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.620952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.661979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 214/429] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:41.688314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.713322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:41.715496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:41.753809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:41.842855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db6770-38a2-434b-9ba0-fe3d505fef69 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:41.869614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 216/430] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:41.872077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.903118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:41.904428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:41.904895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:41.905362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:41.918773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:41.927488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:41.928792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:41.930033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 215/431] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:41.935983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.963408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.010420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea307-2c3c-4037-83cf-72a27a9d3d23 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.040709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.051582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.053600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.053600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.053600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] PATH_INFO: `/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.054781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] RBAC: Authorizing `identity:get_project(project_id=36904b7cd7d8459b94f69b2a0f2639ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.056320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.062780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 217/432] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/projects/36904b7cd7d8459b94f69b2a0f2639ed => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:42.065788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.074916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859a407-dd04-48bb-b0ee-7306a5e6b8e3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.128589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.129447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.129678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.130026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.130945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:42.131316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.133019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.143308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 216/433] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:42.150000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.199147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccaa30-27ad-47f8-82bc-834379da90f4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.235936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.236847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.237737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.238051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.241589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.241589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.242780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 218/434] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:42.248735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.250948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.273155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85288732-ff0f-4297-87ac-9a70da5168e5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.320818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.321486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.322069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.322069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.341231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.389414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99707-3900-465b-a101-1b8776e3c439 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.411996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.414021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.425707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.426380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.426664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.426938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.427771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:42.428085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.429531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231088c9-a103-437b-add9-c8d9c9de20fc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.439797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 219/435] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=36904b7cd7d8459b94f69b2a0f2639ed&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:42.439797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb14ac-d6d0-4499-8f95-abba28637513 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.439797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb14ac-d6d0-4499-8f95-abba28637513 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.439797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb14ac-d6d0-4499-8f95-abba28637513 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.439797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 220/436] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:42.448116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.448116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.448116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.465184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:42.466535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:42.534504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.557729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 221/437] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:42.573020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 217/438] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:42.579390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.583946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.649053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.712773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f8b62-ce90-4a87-bd3a-5dfdf8ba7fbe None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.723020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d4765-d08c-49f0-98e0-54f6cec340a6 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.754623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.755742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.756379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.756772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.758741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.760870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76742e2e-df1d-4f52-814f-db6c51a3db46 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.763581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 222/439] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:42.765707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf17c5-0cc6-4687-82a1-a82bc6a1d62e None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.766173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf17c5-0cc6-4687-82a1-a82bc6a1d62e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.766625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf17c5-0cc6-4687-82a1-a82bc6a1d62e None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.766922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.767733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.768015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.768355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.769303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 223/440] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:42.772639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf17c5-0cc6-4687-82a1-a82bc6a1d62e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.782588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8a1c335a-35cf-4bb4-b612-4f68c059f58b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:42.791113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:42.792660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:42.794847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 218/441] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:42.795913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.795913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.795913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.817879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:42.819281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:42.857164 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.903860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 219/442] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:42.906350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:42.906490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf17c5-0cc6-4687-82a1-a82bc6a1d62e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.937836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:42.949510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.950428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.950710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.950988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.953102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.953706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.955392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 224/443] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:42.956273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.012692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa82c0-e279-4c06-a909-7547612f5ff1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.048580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.049253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.050100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.050398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.051156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:43.051468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.052881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.061264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 220/444] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:43.062113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.063685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015dd8c-2327-4b18-b57b-e1fb403eef5b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.095351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.100020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.100897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.101173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.101447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.111712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:43.119957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:43.120864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:43.121709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 225/445] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:43.122366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.172489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12fcfe-6b0c-48d7-b9fd-006c02980408 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.176516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.207366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.208021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.208299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.208571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.209399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=b2a89d6203584406a6a215144e4dee65, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:43.209741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.211174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.217228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 221/446] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=b2a89d6203584406a6a215144e4dee65 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:43.217863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.230375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38c3d3-105f-43fc-bde9-cff8193b6a64 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.275575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.276262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.276553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.276837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.365480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.370651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.372261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.373878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272779e7-de9c-47b0-8d04-26755f4d4809 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.416374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.416944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.417240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.417490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.418317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:43.418620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.420009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.432199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 222/447] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:43.437813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.440166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.499275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 226/448] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:43.503804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.566491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1ae4-aacb-45fb-b760-1f506f66b4f7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.607070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.607872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.608050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.608298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.626472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfd08a-7bcf-4812-b921-38c5983ff7ae None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.641414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.664043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.664911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.665190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.665468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] PATH_INFO: `/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.666697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] RBAC: Authorizing `identity:get_project(project_id=1b20bb02f67a4cb38bd35a1b258c2a4e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.668138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.669854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 227/449] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/projects/1b20bb02f67a4cb38bd35a1b258c2a4e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:43.676162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.687418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.688907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.697822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.776484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782823d-d311-44a0-a972-b82742fe14c9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.791676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 223/450] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 09:03:43.797303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.812107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.812966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.813238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.813509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] PATH_INFO: `/v3/groups/b1006652c4cf410581f608aea7802200` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.814779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] RBAC: Authorizing `identity:get_group(group_id=b1006652c4cf410581f608aea7802200)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.816364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.818030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 228/451] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/groups/b1006652c4cf410581f608aea7802200 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:43.823818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.858056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.901949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e8fbc-81ec-4174-9a9d-85cb84aa85a4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.912936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:43.925766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106565-8d3e-44da-8ed7-fc485f24c522 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:43.937546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.938401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.938678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.938952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] PATH_INFO: `/v3/projects/97e449c5adf9473b93e84773b7f3aad3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.940370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] RBAC: Authorizing `identity:get_project(project_id=97e449c5adf9473b93e84773b7f3aad3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.941890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.947889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 224/452] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/projects/97e449c5adf9473b93e84773b7f3aad3 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:43.949008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:43.966746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:43.967408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:43.967698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:43.967972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:43.968828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] RBAC: Adding query filter params (group.id=b1006652c4cf410581f608aea7802200, role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:43.969144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:43.970643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:43.977547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 229/453] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/role_assignments?group.id=b1006652c4cf410581f608aea7802200&scope.project.id=1b20bb02f67a4cb38bd35a1b258c2a4e&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:44.060602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5891d-67ca-48f9-a2f6-04f4cac18418 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:44.087868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:44.096814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:44.097770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:44.103798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:44.103798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] PATH_INFO: `/v3/groups/2ff37dde1367456aa324d84f8cd2cc49` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:44.103798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] RBAC: Authorizing `identity:get_group(group_id=2ff37dde1367456aa324d84f8cd2cc49)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:44.103798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d4787-0ba4-451e-9bd7-ddde6dd9b760 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:44.103798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 225/454] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 21 09:03:43 2022] GET /identity/v3/groups/2ff37dde1367456aa324d84f8cd2cc49 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:44.108808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:44.212185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578869-b4e7-4f9f-a3b8-b17457b816d2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:44.245726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:44.246418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:44.246704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:44.246977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:44.247814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] RBAC: Adding query filter params (group.id=2ff37dde1367456aa324d84f8cd2cc49, role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=97e449c5adf9473b93e84773b7f3aad3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:44.248128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:44.249585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290585d-eee5-4a43-b4a4-ecfcbe18701a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:44.256296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 230/455] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 21 09:03:44 2022] GET /identity/v3/role_assignments?group.id=2ff37dde1367456aa324d84f8cd2cc49&scope.project.id=97e449c5adf9473b93e84773b7f3aad3&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:46.882373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c1580-a7b2-4f04-9522-e41eed17bfed None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:46.883673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c1580-a7b2-4f04-9522-e41eed17bfed None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:46.884169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c1580-a7b2-4f04-9522-e41eed17bfed None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:46.886113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 226/456] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:46.892281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:46.893419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:46.894184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:46.918547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:46.920085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:46.939089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:47.011425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 231/457] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:47.054923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c1580-a7b2-4f04-9522-e41eed17bfed None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.183058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c1580-a7b2-4f04-9522-e41eed17bfed None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.225116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:47.226324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.226811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.227322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.246285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:47.248089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-db0bbf49-4d9d-4e90-8747-7770bdce6986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:47.275936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:47.276853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:47.277733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:47.277733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:47.277733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.277733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:47.279684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 227/458] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:47.286199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.322776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef479-1498-4d6e-9eb0-b114fdc5fa7c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.323419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef479-1498-4d6e-9eb0-b114fdc5fa7c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.323895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef479-1498-4d6e-9eb0-b114fdc5fa7c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.325707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 228/459] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:47.327860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ca92-b307-4123-94fe-25749a3142a7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.328080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ca92-b307-4123-94fe-25749a3142a7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.328356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71ca92-b307-4123-94fe-25749a3142a7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.330024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 229/460] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:47.332493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801bb0b-3fdf-4f77-b6bf-45e7f1cd3f03 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.332770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801bb0b-3fdf-4f77-b6bf-45e7f1cd3f03 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.333043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801bb0b-3fdf-4f77-b6bf-45e7f1cd3f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.353554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3801bb0b-3fdf-4f77-b6bf-45e7f1cd3f03 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:47.354794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3801bb0b-3fdf-4f77-b6bf-45e7f1cd3f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:47.401581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:47.415312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65253-8ec3-4ff9-8da9-537c8b57389d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.427213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 230/461] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:47.428836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.429130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.429409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.452026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:47.452922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.453346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.453810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.454671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:47.454982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:47.455304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:47.456749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:47.457473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20268-04e9-43ec-be1e-7824c1aaaedb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:47.470378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 232/462] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:47.472241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a42ca-e113-46ca-aef5-ef126c0f83db None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.472533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a42ca-e113-46ca-aef5-ef126c0f83db None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.472810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a42ca-e113-46ca-aef5-ef126c0f83db None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.477681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 233/463] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:47.477681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a42ca-e113-46ca-aef5-ef126c0f83db None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.489772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:47.536014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 231/464] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:47.542811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.591503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a42ca-e113-46ca-aef5-ef126c0f83db None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.631736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:47.632901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.633463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.633895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.650681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:47.652169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:47.663461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d653-c27d-4014-acfc-0110d96c760b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.670553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-b0454b41-08fa-4a0c-b38e-699dabf4bf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:47.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:47.673074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:47.673984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:47.673984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:47.673984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.673984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:47.674849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 234/465] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:47.676289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761418-cc78-4205-874b-50a6cde41925 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.676575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761418-cc78-4205-874b-50a6cde41925 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.676856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62761418-cc78-4205-874b-50a6cde41925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.694181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-62761418-cc78-4205-874b-50a6cde41925 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:47.695393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-62761418-cc78-4205-874b-50a6cde41925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:47.706803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:47.708255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.709001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.709278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.710026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:47.711482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:47.752329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:47.765947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 235/466] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:47.766847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62761418-cc78-4205-874b-50a6cde41925 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.826252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 232/467] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:47 2022] POST /identity/v3/users => generated 246 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:47.827269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:47.898797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62761418-cc78-4205-874b-50a6cde41925 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.946786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:47.947662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:47.947950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:47.948229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:47.961841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:47.963613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:47.970200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3979-3fa9-4b66-8674-5adf6b189b3b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:47.985366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:47.986365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:47.987366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:47.987366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:47.987366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:47.987366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:47.992358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 236/468] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:47.993276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.020700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.021763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.022253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.022701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.023445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:48.023808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.025468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.041332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 233/469] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:48.041655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.058750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.076346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.128805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c712c5-2d56-4df5-a37f-547ded0cffc8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.156260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9e27b-b010-407c-942c-a7b46524772f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.171558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.173623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.177391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.177391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.190236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.191927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.193863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.194899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.195507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.195802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.196557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:48.196868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.198285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e7f78142-1813-4223-b0bb-159d173e634b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:48.211144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:48.212277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:48.213129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:48.213129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:48.213129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:48.213129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:48.213129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 237/470] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:48.213903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95d51-47d5-4af7-8344-447fc9b0a850 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.213903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95d51-47d5-4af7-8344-447fc9b0a850 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.214155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95d51-47d5-4af7-8344-447fc9b0a850 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.215562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 238/471] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:48.216085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95d51-47d5-4af7-8344-447fc9b0a850 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.225628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 234/472] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:48.225628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.318947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.321075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.331492 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95d51-47d5-4af7-8344-447fc9b0a850 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.342115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da2c7-afd6-4e92-a786-599799056b10 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.370860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.371572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.371884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.372152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.372982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.374586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.381116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.381998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.384175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.384175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.384389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:48.385033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.386545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e6a10-9052-43df-96e1-be242fb72f96 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.399375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 235/473] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:48.400763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.401052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.401381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.418482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:48.419686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:48.487561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 236/474] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:48.488229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.509902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 239/475] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:48 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:48.518301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.606848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.640327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81a3d-8f23-45c2-80ce-74c55779e34a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.673063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a70c47-f054-44f7-82cc-5a863fc26a31 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.684428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.685139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.685458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.685795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.686544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.687996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.715558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.716242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.716522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.716798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.717504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.719039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:48.802618 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 237/476] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:48 2022] POST /identity/v3/users => generated 248 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:48.803369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:48.912723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 240/477] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:48 2022] POST /identity/v3/users => generated 249 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:48.932125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e04a-e2db-4331-843e-1a8c400398db None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:48.976757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:48.991657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:48.992369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:48.992699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:48.993013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:48.993823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:48.995329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:49.039289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.sql.core [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 09:03:49.039289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 09:03:49.039289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [parameters: {'id': '94987594741047cab3c1640ee779b5e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 09:03:49.039289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80464) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:03:49.057107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:03:49.058074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application yield resource Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise self.value Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application session.commit() Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 09:03:49.058984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.flush() Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application compat.raise_( Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 09:03:49.059855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:03:49.060772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:03:49.062504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [parameters: {'id': '94987594741047cab3c1640ee779b5e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:49.065309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 09:03:49.067992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:49.070353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 238/478] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 21 09:03:48 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:49.070515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:49.079438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:49.209293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a01e-b3dd-4259-9db8-52d5362e9296 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:49.246538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:49.247729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:49.248239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:49.248711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:49.261605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-6b855f94-b164-47c4-b61b-98ef47ce0e19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:49.271177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:49.272105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 09:03:49.272908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:49.275661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 241/479] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:03:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:49.281079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:49.397049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b8f-c948-4421-8f63-6a7b346f5a3f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:49.434472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:49.435551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:49.436036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:49.436514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:49.437465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:49.438016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:49.439769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f4e7-efb0-4379-8585-bb1cadf386fe None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:49.449584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 239/480] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:50.153546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e7b-d273-4214-a836-b58fb50b09a1 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.154584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e7b-d273-4214-a836-b58fb50b09a1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.155075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0e7b-d273-4214-a836-b58fb50b09a1 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.156886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 242/481] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:50.163049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.163512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.163773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.186592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:50.187811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:50.259290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:50.284473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 240/482] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:50.310102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0e7b-d273-4214-a836-b58fb50b09a1 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:50.415271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:50.457084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0e7b-d273-4214-a836-b58fb50b09a1 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:50.498934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:50.500087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.500598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.501072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.517481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:50.526700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:50.527613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:50.528453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:50.536235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 243/483] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:50.537283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:50.700532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330b41-dd3e-4379-a0df-05b80b4408aa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:50.755675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:50.756352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.756629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.756899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.757679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:50.758238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:50.759623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa54e2a-ca1c-4894-b79b-ae89c0883e51 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:50.773027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 241/484] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:50.778824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:50.911296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785ab0-026e-47c2-b4f3-0dd5afd72a74 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.911684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785ab0-026e-47c2-b4f3-0dd5afd72a74 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.911858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785ab0-026e-47c2-b4f3-0dd5afd72a74 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.913322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 242/485] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:03:50.922416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:50.922889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:50.923329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:50.938352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514d562-93cf-4f76-bda4-14db31b80d57 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:50.951745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:50.953147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:50.983189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.006762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.007790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.008478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.008902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.032046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.033847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.036575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:51.058779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:51.059692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:51.060541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:51.060541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:51.060541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:51.060541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:51.060541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 244/486] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:51.067273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.103766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 243/487] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:51.148945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.199077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a77b-c5e8-4977-84b3-9c233e26d8c2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.261964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.262551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.262834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.263108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.263836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:51.264143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.265522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.311633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 245/488] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:51.312622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.341237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a48fe-b47a-469e-a6af-0afc9cdb6348 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.379023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.379817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.380095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.380368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.392054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:51.394673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-02cd496a-dc5c-47bd-a9c7-b6fe1ac95521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:51.401790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:51.402679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:51.403472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 244/489] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:51.407746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7724b-5855-4615-b4ef-3deffe852c33 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.408158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7724b-5855-4615-b4ef-3deffe852c33 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.418665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7724b-5855-4615-b4ef-3deffe852c33 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.418665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 245/490] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:51.418665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7724b-5855-4615-b4ef-3deffe852c33 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.463590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.483812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fde63-12b6-45f8-a5d8-49f0d4dcd0f8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.522430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.523504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.523977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.524476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.532772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.534577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.542907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7724b-5855-4615-b4ef-3deffe852c33 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-185768aa-f95b-481c-bd74-39f968163e5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:51.553615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:51.554569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:03:51.555471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:51.558283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 246/491] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:51.559837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.560334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.560794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.579180 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:51.581388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:51.590101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.590846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.591231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.591569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.592436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:51.593058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.594708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.610026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 246/492] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:51.610978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.661742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 247/493] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:51.663133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.710677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.721433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.725514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a76d28-f05c-4402-a9a5-b6209339597f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.764845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.765913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.766428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.766914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.768289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:51.768783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.770429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.799335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a839-4fbd-437e-890b-033a8b86bacf None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.813240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 247/494] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:51.815290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.843498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.844633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.845096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.846163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.860951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:51.864534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:51.889279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:51.890320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:51.891193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:51.891193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:51.891193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:51.891193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:51.894571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 248/495] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:51.895673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:51.942145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662d394-0f86-4112-a3bf-026ace2077a4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:51.978854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:51.979655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:51.979943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:51.980221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:51.985953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:51.991834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:51.999597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:52.005233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 248/496] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:52.006129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.015092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c1b3-27d8-4ca6-912e-4c59dc849462 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.023269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.055032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.055032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.055032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.055032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.114487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1427ab-890b-46a4-810b-80f6d19748e7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.127886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.129393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.157800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.159805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.160338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.160781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.162116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:52.162825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.164351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651c0d-f800-4df2-99bf-92e7804be727 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 249/497] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ae4-403a-498f-a46e-3eefe1117c27 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ae4-403a-498f-a46e-3eefe1117c27 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1ae4-403a-498f-a46e-3eefe1117c27 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 250/498] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:52.185181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1ae4-403a-498f-a46e-3eefe1117c27 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.224007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.246846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 249/499] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:52.247972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.279382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.303835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1ae4-403a-498f-a46e-3eefe1117c27 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.340072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.340657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.340945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.341220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.342009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:52.342525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.343735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d9c2-5e65-4053-a0c6-f6cf8beef7c8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.349261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf2a25-bb46-4af6-bc51-3fe6a23489ad None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.352348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 251/500] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:52.353717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.354076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.354426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.371092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:52.372291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:52.384824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.385664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.385948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.386222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.393876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.395328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d6f78be9-dfca-4f43-bf78-5901367ec743 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:52.410150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:52.411280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:52.412184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 250/501] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:52.412747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b48f-372d-42ac-b959-2df058248431 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.412812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b48f-372d-42ac-b959-2df058248431 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.413056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b48f-372d-42ac-b959-2df058248431 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.414522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 251/502] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:52.415029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b48f-372d-42ac-b959-2df058248431 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.443675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 252/503] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:52.444653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.464673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.516410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.525913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b48f-372d-42ac-b959-2df058248431 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.550486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f82a5-f849-4b44-aba5-44691c435e89 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.559819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.560617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.560900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.561176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.572486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.573904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.586381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.589918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.589918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.589918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:52.592239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:52.593152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:52.594006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:52.594006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:52.594006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:52.594006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:52.594006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 252/504] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:52.594597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.601974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.603541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6bc84361-663b-4ead-93b7-f036dcb82c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:52.621582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:52.622456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:52.623298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:52.623298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:52.623298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:52.623298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:52.623298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 253/505] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:52.624051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.624344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.624623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.642105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:52.643887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:52.696556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.706783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04342ff-0849-45e9-82f2-729303f109f8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.712837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 254/506] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:52.713726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.742021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.742697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.742979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.743252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.744085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:52.744391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.745855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.769355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.796991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 253/507] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:52.797891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.819688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fbafc-58e7-4a8d-9876-9b8650ef2896 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.854281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.855000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.855278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.855554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.865592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:52.873146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:52.874409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:52.875253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 255/508] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:52.876005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.904110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313d32-cede-470f-b0ef-575b8ea40da4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.938623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:52.939826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:52.940167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:52.940446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:52.941171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:52.941511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:52.943036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:52.954347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 254/509] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:52.955720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:52.967185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:52.978399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b7d3-97f0-4664-a659-5d7aab6c26b1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:52.989292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.013439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.014137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.014424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.014812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.015553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:53.015865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.017258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.034833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 256/510] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:53.035701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.059695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d17a8-8c7f-4925-9e5a-e37288e77232 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.099715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.100529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.100812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.101092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.115936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.116563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:53.137409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:53.138383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:53.139227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:53.139227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:53.139227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.139227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:53.139858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 255/511] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:53.141064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.158574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d38f-47b1-4187-af39-ebe9215efd82 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.204763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.205022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.205480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.205793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.206076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.247857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3d49c-72ad-455d-a1a7-05f7479a7926 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.249177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.281575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.283089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.284626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.285301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.285667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.285883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.286672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:53.286963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.288338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.296795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 256/512] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:53.297661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.401222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 257/513] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:53.402037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.416431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90353df-15d3-4e94-b4e0-d96eb3070724 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.440177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.454928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.455844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.456142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.456423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.463626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.465097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.473692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:53.481374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:53.484889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 257/514] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.511002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc387-e629-4e65-add2-bb24402ee75e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.552893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.553723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.554047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.554384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.562206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.563695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:53.580174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:53.581802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 258/515] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:53.589333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.600027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788438a-09a3-4a45-ad4b-f16da6912a6d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.638658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.639336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.639616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.639899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.640624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:53.640932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.642417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.655372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 258/516] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:53.656387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.694286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11b213-f6c3-45ee-9f29-f3220ffec1e1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.706845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.724587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.730510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.731308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.731634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.731909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.743026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.744519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:53.763388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:53.764358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:53.765193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:53.765193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:53.765193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.765193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:53.765193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 259/517] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:53.765531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.778378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed6dc-3a77-440d-82b2-c667a4d04ec2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.812876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.813701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.813984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.814322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.825594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.827058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:53.844214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:53.845081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:53.846061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:53.846061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:53.846061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:53.846061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:53.846061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 259/518] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:53.846333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.875880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dca6-9053-4654-89d3-34e55cc779e2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.911447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.912029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.912309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.912585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.913368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:53.913712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.915184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:53.933358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 260/519] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:53.934247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:53.943524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.949939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0926-72c2-4351-aac7-307eb9b6130f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:53.979723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:53.984561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:53.985259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:53.985523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:53.985836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:53.987303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:53.987615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:53.989137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.007014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 260/520] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:03:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:54.008440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.039441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a70661-13b6-4d02-aac1-0ff30788d762 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.072953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.073663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.073951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.074215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.074947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.076442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.109581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87e9a2-92c1-48e8-a4df-e562e5276d8a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.144062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.144722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.145009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.145290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.146038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:54.146350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.147953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.159100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 261/521] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:54.159878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.174610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.178571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 261/522] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:03:53 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:03:54.179398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.276804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c6ac3-ce0b-4306-be3d-31af12a41eda None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.291923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.296302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff342353-e023-4ee2-9648-e03c8f1ad01f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.327187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.328244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.328705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.329274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.330779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:54.338459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.338459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.344288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e292770-3791-4205-8378-c185600913e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.344977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292770-3791-4205-8378-c185600913e2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.345265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292770-3791-4205-8378-c185600913e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.346118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292770-3791-4205-8378-c185600913e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.346995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e292770-3791-4205-8378-c185600913e2 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:54.347314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e292770-3791-4205-8378-c185600913e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.348781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e292770-3791-4205-8378-c185600913e2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.355609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 262/523] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:54.356441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e292770-3791-4205-8378-c185600913e2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.363398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 262/524] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:54.364249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.462328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.496591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781af1-f8a0-45b2-a766-47a76e833a56 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.516638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e292770-3791-4205-8378-c185600913e2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.539846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.540652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.540937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.541211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.551422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.553032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:54.569015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:54.576175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:03:54.577275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:54.577917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.577917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.578096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 263/525] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:54.578173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.578173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.578311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.624221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.670694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.672394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.711250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342201b-5af1-46df-b547-d8b2a2a50348 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.749057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.761223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.762929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.763669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.764394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.773598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.776041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.792069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 263/526] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:54.792069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:54.796463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:54.797288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:54.798147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 264/527] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:54.799226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.856262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:54.900034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa56e4-50e2-4fb4-8c2c-1c91c906a1bf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.921745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57e33-b5ff-4f01-909f-44bc548cbb7a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:54.939383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.940332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.940615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.940893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.941774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:54.942091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.943557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.960546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:54.961471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:54.961781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:54.962057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:54.963158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 264/528] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:54.963773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:54.978048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:54.979715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:54.999506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:55.000383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:55.001229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:55.001229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:55.001229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:55.001229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:55.005876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 265/529] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:55.006777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.058180 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.075139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c2acc-b680-43da-9783-d214c0c06c8a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.097068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.113403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.114143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.114424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.114674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.115591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:55.115772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.117231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.121821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228735f0-7e04-40bf-a07f-1925a05aea21 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.131042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 265/530] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:55.132158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.162077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.163127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.163675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.164120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.237875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e46e5-dcd2-49ef-8f13-5acdad73b2b4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.239917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.241728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.273931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.274725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.275093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.275431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.276369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:55.276539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.278095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.292575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.295384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 266/531] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:55.296287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.348820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.360965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 266/532] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:55.362393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.410881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77baaa7-4fed-47c3-af48-a00fdba99273 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.455520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.456224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.456511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.456786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.457792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=fca5883c2c74481f88f33e24fe230198) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:55.458109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.459702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.466776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 267/533] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/role_assignments?user.id=fca5883c2c74481f88f33e24fe230198&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:55.467658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.477705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c43029-be75-4169-8efd-def933d71b55 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.530273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.531029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.531321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.531604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.550965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.552495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:55.574816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:55.576057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:55.576887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:55.584119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 267/534] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:55.590716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.601740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.674538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c00ff-b3cf-4d4d-a1e9-2950b0ec817e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.677332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.719420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c584fdf-336f-4d59-ad77-96a84743c0bf None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:55.756332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.757277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.757985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.758437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.759495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:55.759964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.761692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.775459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:55.776278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:55.776568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:55.776863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:55.783507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 268/535] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:55.793825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.796358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:55.797888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:55.821185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:55.822377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:55.823305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:55.823305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:55.823305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:55.823305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:55.826166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 268/536] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:55.832562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:55.919818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:55.985866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e691f1-bce6-45a0-b2cf-6900cfed68e8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:56.020031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade989-3f95-468e-81ec-456cfcec4454 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:56.042408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:56.042996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.043333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.043611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.044453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=dad643f7b3004fafb5d22ec1360ad9e8) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:56.044758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:56.046237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:56.058257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 269/537] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/role_assignments?user.id=dad643f7b3004fafb5d22ec1360ad9e8&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:56.093888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:56.098586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.098882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.099134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.099888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:56.100194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:56.101721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:56.119141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 269/538] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:03:56.125083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:56.272761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03e05-b41f-4ba1-b3d3-d41b6e81895a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:56.313970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:56.321196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:56.322045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.322330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.322604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.331923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:56.336515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:56.352908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:56.353965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:56.354797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:56.362729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 270/539] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:56.368844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:56.400145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:56.504936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978d7f-b0ca-43d9-9fca-06171f5c75c7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:56.541924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:56.542597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.542879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.543154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.543948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:56.544253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:56.545802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb80c2-3ed7-4465-9a1f-9284438b11f3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:56.564549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 270/540] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:56.565543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:56.705362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa7906-afc5-4722-81eb-84c7649ef7dd None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:56.742176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:56.742846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.743130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.743401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.744237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3575daa9fded4cfb9686c817753f246c) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:56.744543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:56.746026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf1bee-5443-4348-818d-a2b4b21f1fc8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:56.759497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7395-92f3-4223-afa1-c448bca0adb4 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.760131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7395-92f3-4223-afa1-c448bca0adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.760131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7395-92f3-4223-afa1-c448bca0adb4 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.761608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 271/542] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:56.761783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 271/542] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:03:56 2022] GET /identity/v3/role_assignments?user.id=3575daa9fded4cfb9686c817753f246c&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:56.767642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.768020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.768263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.794967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:56.796094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:56.833697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cce3f-e9c8-4233-bd94-076263627d09 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.833697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cce3f-e9c8-4233-bd94-076263627d09 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.833697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cce3f-e9c8-4233-bd94-076263627d09 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.836197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 272/543] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:56.846048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:56.846514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:56.846794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:56.889452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:56.890757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:56.912660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 272/544] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:03:56.949959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:56.957181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:56.969178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:56.974646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 273/545] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:57.023172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.096181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb8bb3-4d5e-48fb-a052-01437469edd7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.136981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.137858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.140592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.140900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.164415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:57.172424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:57.173370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:57.174225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:57.176689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 273/546] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:57.183205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.263092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:57.271757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5da3-fc3f-4efc-8fdf-d4347a551387 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.312807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ed6ae-77dc-44c1-905f-f38ba4ac3a4c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.356944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.357577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.357881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.358160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.358972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:57.359290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:57.360737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:57.379613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.380433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.380720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.380998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.385116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 274/547] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:57.391015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.407566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:57.421532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:57.422578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:57.423980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 274/548] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:57.431117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.482765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:57.540881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4764ef-51d8-4224-becd-351f518a3be7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.609799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:57.621296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.622457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.623184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.623660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.642873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4d9f8-72c4-4798-b286-84c7c181f738 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.645644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:57.648137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:57.681957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:57.682923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:57.683789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:57.683789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:57.683789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:57.683789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:57.691015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 275/549] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:57.697236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.716750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.717422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.717745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.718022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.718779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:57.719084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:57.720572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:57.735544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 275/550] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:57.743561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.898420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2412f6-5862-4b0b-863e-4ea5eaa6c95f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.909142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028b1b-2d0b-4fb4-8b9e-ff6d2b18fff8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:57.911600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:57.941432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.942142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.942422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.942695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.943420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:57.943725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:57.945097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:57.958938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 276/551] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:57.965322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:57.975960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:57.976785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:57.977068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:57.977341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:57.994881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:57.996376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:58.030252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:58.031201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:58.032083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:58.032083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:58.032083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:58.032083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:58.032083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 276/552] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:58.038534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.053940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.130050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6180e9-070e-4657-8e68-f007ce818b69 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.159891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0568-3091-4633-b8a2-b50b7fd924cb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.177015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.178890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.179492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.179911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.187991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.189881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.203494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.204265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.204728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.205084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.206156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:58.206539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-90452e39-5aed-4860-bb32-d7540554e86e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:58.207660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:58.208538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:03:58.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:58.210024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.216570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 277/553] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:03:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:03:58.218289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb1be-dc73-47c5-87c2-dbd94e0a5178 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.218795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb1be-dc73-47c5-87c2-dbd94e0a5178 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.219275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb1be-dc73-47c5-87c2-dbd94e0a5178 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.220786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 277/554] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:58.221678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.226383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 278/555] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:58.228157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.228645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.229166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.245812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.250936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:58.252609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:58.336545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 279/556] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:58.337944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.349870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db50c6-ac3e-42a2-b291-ef30ade4d660 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.392619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.393581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.393581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.393865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.395162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:58.395478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.397287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.400719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.426005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 278/557] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:58.426005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.458174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fae20-d03d-46e0-9041-731639cd1953 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.493851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.494654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.494945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.495221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.500854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.502978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.504447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-7cb8fd8c-5d70-4fe6-aaa6-bcc2ebe9276a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:03:58.521075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:58.522577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 280/558] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:58.523540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c29cf-4dde-4102-a6c9-d00fee22bd6a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.524197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c29cf-4dde-4102-a6c9-d00fee22bd6a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.524197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c29cf-4dde-4102-a6c9-d00fee22bd6a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.529467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 281/559] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:58.529467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c29cf-4dde-4102-a6c9-d00fee22bd6a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.535190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375747a-bb33-4066-9ae1-3a0801f2df9c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.572677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.573484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.573803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.574137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.585391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:58.593183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:58.594431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 279/560] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:58.596100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.640604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.653158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c29cf-4dde-4102-a6c9-d00fee22bd6a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.694579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.695150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.695430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.695700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.710400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e149c1-2925-41a9-b27c-0f3aa10c671a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:58.750986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:58.752795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.753087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.753525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.754520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:58.754981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.756737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc74b90-5591-4c7f-a552-bb8d51d0d77c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.758878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.775750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 280/561] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:58.775750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:58.775750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:58.775750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:58.781864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:58.783392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:58.799752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:58.801097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:58.872408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 281/562] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:58.873999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.887153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:58.898600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 282/563] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:03:58.899449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:58.994353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5494c99-af58-49bc-a45d-39049e57604d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.009002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b988a5-3c7a-4196-93b2-14606bd4f708 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.018606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.033625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.034630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.035057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.035472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.036480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:59.037059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.038617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.044707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.045502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.045899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.046175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.053328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 282/564] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:59.054464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.058447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.059906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:59.078046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.079182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.080402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:59.080402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:59.080402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.080402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:59.081980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 283/565] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.082846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.126269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.159172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9086-ba0f-40a6-bb86-3ee7d18a4ea9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.186337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db607a1-9b3d-47d0-8621-2a3d0aa196e7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.195066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.195862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.196146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.196419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.207487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.208985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.219848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.220780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.221062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.221337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:59.225806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.226766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.227664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:59.227664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:59.227664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.227664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:59.231576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 283/566] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.231824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:03:59.232343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-d958a891-9ca0-4ba4-9544-62001232d1f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:03:59.240048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.241038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:59.241949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 284/567] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.242641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8d27-feab-455a-9237-6c9c8a0f6aeb None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.242841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8d27-feab-455a-9237-6c9c8a0f6aeb None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.243345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8d27-feab-455a-9237-6c9c8a0f6aeb None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.244413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 285/568] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:03:59.245047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae8d27-feab-455a-9237-6c9c8a0f6aeb None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.273726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.342139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad106a2b-1dee-4402-8193-23e60a58be24 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.353820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae8d27-feab-455a-9237-6c9c8a0f6aeb None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.355476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.379097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.379963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.380255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.380526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.390619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.390956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.391275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.391554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.391838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.392618 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:59.392773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.393321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.394285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.406292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 286/569] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:59.407083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:59.411183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.412160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.413063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:59.413063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:59.413063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.413063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:59.413525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 284/570] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.414348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.504080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.511501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc08aa-5467-4281-83e9-5c5668f5e2a0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.516158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e62af9-0eab-4248-afe5-85cd49bcc126 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.546423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.547250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.547674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.548044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.549716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:59.550069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.551634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ab90-a6a1-49f9-a352-127b4448a69d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.553181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.553900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.554187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.554466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.555220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:59.555531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.556881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.564593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 287/571] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:59.569716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 285/572] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:59.569855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.570047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.570139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.570139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.585030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:03:59.586281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:59.603998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.654047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 288/573] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:03:59.654921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.683343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f0f46-a0e5-4469-a7ee-098d43bb2157 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.723422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.724369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.724758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.725140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.732281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.733766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:59.749091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.750123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 286/574] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.751033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.764475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.767955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f4799-5918-469d-8ec1-b015a7bf592b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.803263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.803933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.804197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.804469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.805181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:03:59.805486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.806886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.818856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 289/575] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:03:59.819488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.837508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.854567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382bc80-ccf0-4310-be8e-90120e5d1cf3 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.890769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.891568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.891934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.892252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.899352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.900886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:03:59.914984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.915958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:03:59.916850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 287/576] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.917330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:59.926935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e610-9422-4e9a-b608-5912a0cc4968 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:59.960925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:59.961756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:59.962037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:59.962310 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:59.973292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:59.974774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:59.987265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:03:59.991747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:03:59.992646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:03:59.993608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:03:59.993608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:03:59.993608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:03:59.993608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:03:59.993608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 290/577] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:03:59.994028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.020237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967de1-e0ac-4707-aa08-360c23ebe716 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.054092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.054921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.055210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.055491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.055648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.066346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:00.074298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:00.075417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:00.076264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 288/578] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:00.076965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.100018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663105d-d1bd-4dbd-b9f4-e22638d22260 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.135486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.136150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.136433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.136709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.137494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.137836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.139260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.151351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 291/579] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.152161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.182082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef583-856f-4133-b7c1-e61b4ab98760 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.211420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.217008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.217850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.218137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.218413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.226540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.228058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:00.242670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:00.243776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 289/580] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:00.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.258421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dda63-cf9f-4f7e-8f0f-b1e745d8583e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.284494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.295515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.297373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.297373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.297373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.297774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.297774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.300003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.314237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 292/581] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.315311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.351575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc36ea-bfb2-426d-8a89-07740388c0bb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.385133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.385829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.386119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.386399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.387125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.387433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.388873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.401314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 290/582] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.401314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.420473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383c6-44ac-42d0-b58e-ebd6cc8e39dd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.454149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.456834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.457509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.457826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.458099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.458844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.459151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.460642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.469047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 293/583] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.469701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.506704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df06c3-8e06-4ba5-905a-76a82445b6b0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.560033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.580118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.581110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.581333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.581605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.596377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=923ba7b9f0414b6e8d9a3ad4cb256ebf, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.597855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.614137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3cfb-9db6-44ff-bd46-cdf181a8b107 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.648198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.648869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.649174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.649457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.650353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.650664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.652090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.669954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 294/584] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.670785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.685887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 291/585] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:00 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:00.685887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.787304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.790812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb0b08-d59d-414d-b282-da316fa4f4fc None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.799164 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82380-604b-4e52-aa4f-0098c5477340 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.801871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:00.835168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.835865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.836146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.836423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.843496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:00.844156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:00.844439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:00.844540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.844713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:00.846201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3e3e7115f88940f18234bab2425977ad) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:00.846508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:00.846819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.847922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:00.854899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 295/586] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/role_assignments?user.id=3e3e7115f88940f18234bab2425977ad&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:00.855690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:00.862696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:00.868347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 292/587] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:00.869297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:00.981646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad46-d8cc-4736-8ee7-56b262c1e365 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:00.981853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaa842-d8f7-428a-a6a5-5c014e6e05d2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.022998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.023838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.024123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.024399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.025505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.026374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.026662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.026933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.036512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.038035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.039019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.040529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:01.056677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:01.057712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:01.058606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:01.058606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:01.058606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.058606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:01.058606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 293/588] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:01.058900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:01.060516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:01.061778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:01.061778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:01.061778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.061778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:01.061997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.062083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 296/589] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:01.064270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.083340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.090804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.192139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ebd6-4b10-4efb-8c46-dfe5b7e68192 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.195188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c6f6-93bc-4191-89cb-552e556e8f01 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.234405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.236247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.236830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.237388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.237514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.238093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.238375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.238649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.239277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:01.239406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:01.239664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.240114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.241050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.242007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.261493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 297/590] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:01.261493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.267645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 294/591] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:01.268497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.372110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.391038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac33a45-af4a-441f-87be-2af96cd87749 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.393899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.399159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da398a1-b005-4010-b273-955fe90ff165 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.436643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.437443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.437772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.438113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.446533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.448053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.448185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.449267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.449976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.450464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.451862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:01.452379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.453972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:01.464029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:01.464943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:01.465937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:01.470785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 295/592] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:01.471689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.472784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 298/593] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:01.473958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.580282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0fed-85ce-476b-b50f-6b56f961e122 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.616487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.620366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023c8e-e7a1-45b5-8c0e-fbb465b10ad9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.626862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.628141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.628808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.630107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.645657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.647960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.664459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.665511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.666044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.666536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.667666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:01.668179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.669921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:01.670121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:01.670964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:01.671861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:01.671861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:01.671861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:01.671861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:01.671861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 296/594] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:01.672132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.684869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.694142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 299/595] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:01.694938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.801994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd67e-24d9-4297-ad46-0a0ac40ad06e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.825073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6158df-166f-433f-aacc-c2c02770a411 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:01.845536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.846374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.846657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.846931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.857783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.860012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.872319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:01.873365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:01.873884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:01.874375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:01.875306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:01.875884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:01.877871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:01.878873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 297/596] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:01.880482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.881661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:01.903546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 300/597] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:01.904765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:01.939534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:01.980112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:02.016096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8efb6b-b8f9-445a-b3b5-2a7393d761d8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.025055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef3039-93b8-4526-99a2-3e78bca67452 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.063156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.063799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.064697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.064966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.065074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.065242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/fca5883c2c74481f88f33e24fe230198/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.065732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.066289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.067553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:02.068050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.069733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.090345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 301/598] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 21 09:04:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:02.090965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=fca5883c2c74481f88f33e24fe230198, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.091166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.092561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.194452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 298/599] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:01 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/fca5883c2c74481f88f33e24fe230198/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:02.195593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.218585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5241c0-b091-4f88-86d5-bf0e43c9147c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.258460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:02.294809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.295682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.296114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.296397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.322417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.323922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:02.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:02.358277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:02.359154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:02.361853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 302/600] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:02.370823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.411248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:02.419773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b6656-59dd-45a6-b593-79cb0568a42a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.462006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.462783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.463073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.463347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.476234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.477909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:02.500020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:02.501230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:02.502440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:02.502440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:02.502440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:02.502440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:02.509601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 299/601] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:02.511243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.518605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594fe62-3004-4a69-afa3-6552013ee515 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.618232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.619021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.619225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.619473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.620323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:02.620637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.622125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.652384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 303/602] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:02.657705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.676914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a441f-fdbb-433a-b3f9-bab28e54b362 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.720796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.725475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.739102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 300/603] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:02.746565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:02.755062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:02.757887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:02.867730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b367-bec2-4782-a928-baf684ba8da5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.895747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e3fb-f622-434f-912a-ea703c4e906e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:02.911026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.912055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.912373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.912751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/dad643f7b3004fafb5d22ec1360ad9e8/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.930891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=dad643f7b3004fafb5d22ec1360ad9e8, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.932805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d9092-c0fd-42f7-9697-47b999f57873 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.941664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:02.942841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.943400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.943896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.951562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:02.953262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7a5e40e2-dfee-4475-8807-f92bb67cd9a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:02.968964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:02.970442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:02.971684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:02.972140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 301/604] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:02.973397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975571-c4c7-4faa-9ad5-108b00e9b501 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:02.973721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975571-c4c7-4faa-9ad5-108b00e9b501 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:02.974062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975571-c4c7-4faa-9ad5-108b00e9b501 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:02.975515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 302/605] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:02.982549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975571-c4c7-4faa-9ad5-108b00e9b501 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.056526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 304/606] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:02 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/dad643f7b3004fafb5d22ec1360ad9e8/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:03.058897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:03.059038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897bee5-97cb-4896-b2c2-80588f192c68 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.059270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897bee5-97cb-4896-b2c2-80588f192c68 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.059541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897bee5-97cb-4896-b2c2-80588f192c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.102763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0897bee5-97cb-4896-b2c2-80588f192c68 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:03.104116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0897bee5-97cb-4896-b2c2-80588f192c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:03.131686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975571-c4c7-4faa-9ad5-108b00e9b501 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.198630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.199470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.199753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.200322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.201126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:03.201478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:03.204150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53523964-f23b-47ba-aee9-20e12ebad9a6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:03.227188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 303/607] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:03.228489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e118-0a66-45e8-8f19-f5a9f444e624 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.228772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e118-0a66-45e8-8f19-f5a9f444e624 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.229045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e118-0a66-45e8-8f19-f5a9f444e624 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.230859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 304/608] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:03.232642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577e118-0a66-45e8-8f19-f5a9f444e624 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.233886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 305/609] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:03.239138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.239547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.239918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.269342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:03.270641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:03.287146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:03.355766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 306/610] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:03.356880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.381846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577e118-0a66-45e8-8f19-f5a9f444e624 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.414059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:03.422293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.424077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.424384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.424770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/3575daa9fded4cfb9686c817753f246c/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.443845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=3575daa9fded4cfb9686c817753f246c, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:03.445790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:03.480342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367181-f8ae-47a9-8ec9-a5f917ec55be None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.521045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.521884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.522170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.522445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.534110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 305/611] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:03 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/3575daa9fded4cfb9686c817753f246c/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:04:03.534110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.557747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:03.573980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:03.575039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:03.575935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:03.577194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 307/612] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:03.587954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.628880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:03.741625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83288-ee8b-46d2-b07c-5a82e3924a49 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.783096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.783913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.784359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.784645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.796267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:03.807005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:03.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:03.809302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 306/613] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:03.812476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb0e7-8c43-4fb6-9648-697ce3882ea3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.815676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.869074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:03.914386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.915082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.915362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.915635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.916396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:03.916705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:03.918124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:03.936857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78ea8-e0d7-435c-a759-edae0cec3df4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:03.937739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 308/614] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:03.943344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:03.986136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:03.988068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:03.988366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:03.988648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:03.989416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:03.990211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:03.992249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.004396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 307/615] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:04.010637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.043388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.119218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ee81-3925-4fac-b725-3790abf26122 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.151195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.164939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbc38-4f18-4aa7-9273-6cb15b00b27c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.184465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.185272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.185922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.186207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.198883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.200592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:04.223290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:04.224262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:04.225805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:04.225805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:04.225805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:04.225805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:04.225805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 309/616] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:04.231598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.245976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.246709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.246996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.247274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.272740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.275182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:04.312850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:04.313799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:04.314758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:04.314758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:04.314758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:04.314758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:04.321273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 308/617] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:04.325515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.433587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daae06-a468-4ec2-9770-1b159ef27ebc None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.481923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.498340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6c708-851d-49f5-8901-924147c0b5a3 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.508018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.509015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.510249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.511326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.512266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:04.513695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.516798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcef314-8071-4f9e-9abe-6f7b106f0951 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.545107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 310/618] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:04.555000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cf8-1bbb-46bd-84f0-8abb8eb148c3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.555832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cf8-1bbb-46bd-84f0-8abb8eb148c3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.556309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cf8-1bbb-46bd-84f0-8abb8eb148c3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.558267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 311/619] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:04.559171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288cf8-1bbb-46bd-84f0-8abb8eb148c3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.564759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.565435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.565759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.566037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.566765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:04.567074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.568565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375bef3-6098-4886-a342-bb1c0bdaf536 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.586137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 309/620] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:04.588215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887076dd-559a-43ce-92df-970c4109039f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.588722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887076dd-559a-43ce-92df-970c4109039f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.589212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887076dd-559a-43ce-92df-970c4109039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.609876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-887076dd-559a-43ce-92df-970c4109039f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:04.611909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-887076dd-559a-43ce-92df-970c4109039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:04.614782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.682876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288cf8-1bbb-46bd-84f0-8abb8eb148c3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.696417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 310/621] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:04.697554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887076dd-559a-43ce-92df-970c4109039f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.743712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.744808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.745062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.745450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.753949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.755625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:04.772071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:04.773105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:04.774087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:04.777926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 312/622] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:04.778877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.820735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887076dd-559a-43ce-92df-970c4109039f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.837633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.861813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.862608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.862890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.863163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.872178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:04.873786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:04.875635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:04.891383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:04.892661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:04.893632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 311/623] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:04.894234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:04.914468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161f9a4-15e1-4d68-98bb-ec3a978ed9b9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:04.953223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:04.954203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:04.954493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:04.954763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:04.966589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:04.975056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:04.976248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:04.977153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 313/624] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:04.977938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.030054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0333-7c5a-4dbe-87d0-c317ac180997 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.067170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.068062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.068451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.068832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.069921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:05.070226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.071777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.093102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 312/625] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:05.094202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.114493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c067-89b5-449e-9b3d-bf0b001c2f1c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.116576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.155960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.159782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.161452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.162028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.162711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.164116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:05.164875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.167165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.189886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 314/626] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:04:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:05.193388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.207674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00f6eb-d290-41fe-b137-610e1fa3d646 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.247934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.248635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.248920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.249196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.250220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:05.250535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.252768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.262449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 313/627] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:05.263288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.324162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845fa1-6ffc-4e23-9795-ff8fdc95ce96 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.375280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.376470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.376753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.377085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.387140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6f0ad-23cf-4d98-af32-f49eb731eb8b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.406001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.408039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.427338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.428144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.428431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.428705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.440350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.441836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.446484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.448519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89800bdd-06d2-4f3c-90ab-0b60b02b0857 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:05.461489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:05.462717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 314/628] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:05.463619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.564937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 315/629] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:05.566689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41599cb-6672-4b39-a861-bda61b19bb3a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.567144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41599cb-6672-4b39-a861-bda61b19bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.567429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41599cb-6672-4b39-a861-bda61b19bb3a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.568905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 316/630] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:05.569451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41599cb-6672-4b39-a861-bda61b19bb3a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.583521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db470323-ba8b-45fa-ab50-b067f4a9b9c4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.621595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.622410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.623003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.623003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.635019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.636896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.643017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:05.655241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:05.662627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 315/631] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:05.663533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.683641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.692942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41599cb-6672-4b39-a861-bda61b19bb3a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.729510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.730237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.730519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.730847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.731617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:05.731926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.733307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a69-0697-44af-8c88-b37ee9007913 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.746056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 317/632] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:05.747292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.747628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.747847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.766076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:05.767912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:05.770783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecedeae-d0bb-4500-bdd0-d2e94795dc9c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.808675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.810165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.810465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.810747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:05.823005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:05.824412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:05.845583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 318/633] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:05.845583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:05.845850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:05.846851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 316/634] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:05.847895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:05.911124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.935696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:05.960365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333c0c-e639-459b-a9c7-6180a1b20255 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.966332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7a93-7f69-4856-87c7-756d4fbc3e6f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:05.993283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:05.994101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:05.994378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:05.994649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.001127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.001403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.002043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.002336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.002608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.002724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.003334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:06.003644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.004998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.017346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 319/635] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:06.017686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.018776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:06.020110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:06.020559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.020632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 317/636] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:06.020632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.117350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c1b31-668b-4514-b837-f8e9d07513f6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.123966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da864d6e-bd4d-4f11-9356-cacd6f0af78d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.135876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.152522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.153318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.153631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.153912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.155774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.159886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.160544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.160825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.161105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.161900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:06.162204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.163567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.164747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-a9302cfa-f61f-4a6f-845a-772d511836e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:06.172435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.173432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:06.174914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 318/637] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:06.175954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c67aa-9077-46b3-9a97-eab964d638c9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.175954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c67aa-9077-46b3-9a97-eab964d638c9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.175954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c67aa-9077-46b3-9a97-eab964d638c9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.180130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 320/639] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:06.180130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.180359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 319/639] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:06.180359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c67aa-9077-46b3-9a97-eab964d638c9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.282170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111ad-268b-41cd-aac0-2e34ee2b89b2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.289823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c67aa-9077-46b3-9a97-eab964d638c9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.319899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.320699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.320980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.321250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.328057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.328891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.329661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.329765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.330018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.330500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.330933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:06.331279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.332675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.344283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 320/640] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3fbf51f5-b0f2-440c-8655-60558caddc23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:06.345091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.346193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:06.347161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:06.347708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.347789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 321/641] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:06.347789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.347789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.347975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.364827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:06.366085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:06.390575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.406889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.435643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 322/642] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:06.436480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.451990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520e0d6-7500-4889-87d6-f738260275d6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.487715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.491835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.500045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 321/643] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:06.500861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.553787 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d36c0-b707-4d74-a4c3-306661a19692 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.588130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.588930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.589211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.589485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.596921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.598409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.601281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a6204-d056-4191-a21b-5d03347a09e8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:06.612371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.613283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:06.614435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 323/644] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:06.615363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.619213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.637731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.638563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.638689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.638913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.639200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/3e3e7115f88940f18234bab2425977ad/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.655777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=3e3e7115f88940f18234bab2425977ad, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.657927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.719180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fa14-3144-43c8-aad9-60412a88bc2b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.749442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 322/645] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:06 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/3e3e7115f88940f18234bab2425977ad/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:06.750300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.763681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.764705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.765008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.765281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.766261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:06.767255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.768770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.795279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 324/646] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:06.795279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.892225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe4c4-d031-4a08-aa69-2076a3249ea0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.893297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.928818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2081d5d-aef7-4f3a-8f3c-2ad75a4b46c7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:06.936804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.937988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.938805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.939123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.951503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:06.959463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:06.960023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.960927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:06.962491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:06.963147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:06.963147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:06.963147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:06.963335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 323/647] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:06.963335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:06.978624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:06.980076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:06.996579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:06.997975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:06.999086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 325/648] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:07.000013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.087124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f228-eabe-4baf-8893-d7d674cdbe79 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.116435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd06a-43cc-4588-a965-fc8c651aecd9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.124970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.125668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.126527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.126849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.127583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:07.127890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.129321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.147644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 324/649] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:07.148289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.149375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.155240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.155904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.156191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.156470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.231368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.232757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.252150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.268906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e5cf-4abd-44e4-893a-41b3358aad3a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.317679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.318357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.318643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.318904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.319825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:07.320136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.321513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.333977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 325/650] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:07.335805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.354244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 326/651] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:07.354244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.387794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.440632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ef8db-4247-4eb1-9863-9bdee5457b8c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.466142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab6fec-7a97-46fd-b3fe-d973ac6c9f36 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.474737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.475402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.475685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.475957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.476669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:07.476970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.478363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.491161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 326/652] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:07.492270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.504385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.509605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.510286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.510601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.510863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.511879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:07.512199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.513662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.520540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 327/653] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:07.521753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.639091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21b52-25fe-4a94-a326-58df81708d83 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.643597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.650906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369edb-f044-4580-ba38-a1f2772e45b5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.693066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.693399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.694363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.694553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.694827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.695164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.695275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.695870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.707838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.709277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.713095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.714608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:07.730030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:07.731046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:07.731971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:07.731971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:07.731971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:07.731971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:07.731971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 328/654] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:07.732693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:07.737611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:07.738677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:07.739558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:07.739558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:07.739558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:07.739558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:07.739558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 327/655] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:07.746745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.826586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:07.869934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e418-d2d0-4232-bf53-ef98d43e24fa None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.882726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472efcd-57a5-4d18-a942-59258094ef09 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:07.909355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.910205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.910493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.910768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.919259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.920971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.923519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:07.924376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:07.924669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:07.924947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:07.925707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:07.926026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:07.927405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:07.937078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:07.938088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:07.939458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 329/656] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:07.940063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.940784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 328/657] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:07.946416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:07.953246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.068663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca981c-7074-4fe6-a076-112b065b02ea None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.078080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39553ba8-2e76-4381-b1e1-f5ddc74c0a8d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.092876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.108999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.110151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.110786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.111264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.112335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:08.112924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.114734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.122989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.123819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.124105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.124384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.126471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:08.126791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.128166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.143290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 329/658] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:08.144253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.146385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 330/659] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:08.147779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.220776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.252292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476602d-60bb-44ed-8d39-fd1bec5d7536 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.259000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e244f-139e-44c5-90ef-ac149d1b88c9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.288855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.289689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.289973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.290247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.295717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.296549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.296983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.297267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.298657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.307653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:08.323591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:08.324525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:08.325414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 330/660] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:08.326149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.368627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.379975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.381841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.435798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593b15-533f-456e-a91c-a4a39914af2e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.470339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.473440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.474338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.474625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.474898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.483463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.485015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:08.501784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:08.502842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 09:04:08.503866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:08.508096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 331/661] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:08.508799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.516178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 331/662] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:08.517554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.619550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.623523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287dd0-91e9-4770-9853-38a72d31f174 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.647574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6e-c487-49dd-a4b4-3bc32e7387b5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.659462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.660156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.660404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.660679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.661509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:08.661865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.663307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.676868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 332/663] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:08.677858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.695181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.696311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.696893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.697436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.698569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:08.699107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.700941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.722770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 332/664] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:08.724138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.759154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.789726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb4a5-9fc2-4925-9d97-b754efc591d1 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.825485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.826322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.826606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.826884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.839587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.841168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.860318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982bece-cf8c-49a3-8510-6f38cb554bd5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:08.868085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:08.869085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 333/665] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:08.871021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:08.884027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:08.910753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:08.911418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.911695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.911964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.912790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=fca5883c2c74481f88f33e24fe230198) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:08.913120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:08.915107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad531ecf-ee42-4bb9-b796-ab2ec2b9672c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:08.925758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 333/666] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/role_assignments?user.id=fca5883c2c74481f88f33e24fe230198&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:08.927120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1e3-64e6-4fbd-a4ef-df94cbf9992c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:08.927412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1e3-64e6-4fbd-a4ef-df94cbf9992c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:08.927690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1e3-64e6-4fbd-a4ef-df94cbf9992c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:08.931443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 334/667] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:08.931443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b1e3-64e6-4fbd-a4ef-df94cbf9992c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.002221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884775c6-cfeb-464a-b7e3-7c37b0371551 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.052932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.053920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.054386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.055501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.056385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.076071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b1e3-64e6-4fbd-a4ef-df94cbf9992c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.121282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.122541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.123080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.123365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.124366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:09.124889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.127979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b986d-8984-43d2-9ee6-7b64a5bfc248 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.146297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 335/668] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:09.147211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.147630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.147924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.148204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.149790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.164459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.170232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:09.171069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:09.276074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 336/669] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:09.276963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.306370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 334/670] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:09.319663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.374103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.391646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10c66-6b32-423a-b3ec-5e54425884f9 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.433148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.433886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd06639-b941-44ff-abce-c1c46123656f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.434248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.434630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.435004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.448357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.451940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.454322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:09.474663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:09.475933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:09.476863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 337/671] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:09.477341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.480857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.481955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.482452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.482924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.496183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.500757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:09.518659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:09.519597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:09.521069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:09.521069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:09.521069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:09.521069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:09.523248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 335/672] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:09.524441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.604881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2ea04-19d5-4380-9547-9de37db4fe7a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.653780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.653780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.653780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.653780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.661051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.665329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215775e-08b2-4fbf-83a4-fbc26ae840c1 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.666244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:09.675196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:09.677243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 338/673] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:09.678178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.713288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.714349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.714809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.715252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.716341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:09.716888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.718644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.733390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 336/674] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:09.734509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.768660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.801787 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182835-e240-4ded-a450-8fe3f9f8d665 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.838709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.839485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.839842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.840195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.841005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:09.841382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.842860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.855523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4a84-f813-46ef-b8b8-ce735b79699c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:09.861088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 339/675] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:09.862183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.898611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:09.899653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:09.900305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:09.901648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:09.902627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:09.903142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:09.904790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:09.917080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 337/676] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:09.918526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:09.928860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:09.973449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e20b8-340f-4b1d-9c4c-0a0512796526 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.009116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.010098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.010529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.010949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.011934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=dad643f7b3004fafb5d22ec1360ad9e8) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:10.012248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.013700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28c42-bb9f-488c-af56-cecc1062450f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.015709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 340/677] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/role_assignments?user.id=dad643f7b3004fafb5d22ec1360ad9e8&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85bbd-ad4f-45ae-83fd-d54eae0c3267 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85bbd-ad4f-45ae-83fd-d54eae0c3267 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85bbd-ad4f-45ae-83fd-d54eae0c3267 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 341/678] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:10.025875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef85bbd-ad4f-45ae-83fd-d54eae0c3267 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.050566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608264f-32af-4cfb-9f4c-685016f3a92a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.109835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.111278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.112680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.112969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.122496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.124319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-1c9a107e-50fd-4912-b19c-5e61a943ee78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:10.146347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:10.147323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:10.148233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:10.152994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 338/679] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:10.153244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef85bbd-ad4f-45ae-83fd-d54eae0c3267 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.154472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.154911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.155494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.182901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.186435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:10.187255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:10.199302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.200212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.200505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.200783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.213761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.215700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:10.236748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:10.237753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:10.238659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:10.238659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:10.238659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:10.238659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:10.239826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 342/680] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:10.240133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.275891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 339/681] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:10.276662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.382831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a3d4-f9ae-4a08-9ac6-45e0372ded85 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.383894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.413949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965cbbc-ffe6-4977-8a6a-fd605715069b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.426707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.427856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.428763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.429193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.430416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:10.431123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.433170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.449318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.450030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.455002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.455002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.455002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:10.455002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.455002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.455888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 343/682] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:10.457675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.472846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 340/683] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:10.472846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.508830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.593713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31471-d02a-40f4-a3d4-cc0189f6b1a8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.595583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2313c-0295-45e3-ba6c-011829ef29a0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.638768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.639666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.639873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.640294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.640646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.640859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.641035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.642035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.642835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3575daa9fded4cfb9686c817753f246c) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:10.643301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.645129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.647700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.653426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 341/684] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/role_assignments?user.id=3575daa9fded4cfb9686c817753f246c&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:10.654548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.661867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:10.674905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:10.676123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:10.677192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:10.688885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 344/685] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:10.693391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.843464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253185ae-69ee-4174-bac5-288fab951b9f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.849213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:10.857010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f19-aa61-4e1f-ab0e-72d12e595b3b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:10.882743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.883555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.883833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.884103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.892807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.894307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.903826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:10.904515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:10.904810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:10.905092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:10.905924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:10.906235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:10.908443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:10.910284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:10.911206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:10.912155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 342/686] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:10.918791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.921266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 345/687] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:10.927864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:10.997833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.053049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fece08-744f-41a3-a2df-6696ea531eb3 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.076978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14915-9b5a-4c01-823b-ffc9953f3f7e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.091533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.092200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.092541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.092815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.094145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:11.094145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.096083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.116419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 343/688] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:11.122559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.124889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.125830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.126121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.126401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.139013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.140613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:11.163432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:11.164404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:11.165409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:11.165409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:11.165409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:11.165409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:11.169341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 346/689] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:11.170586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.188426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.292235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecdf85-c631-4fd7-a7b0-4bb3f97617e4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.318811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.338576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.339963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.340429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.341118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.350629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87df67-de55-4c19-93c8-63c093f884f5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.389890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.390601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.390837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.391226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.392462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:11.392769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.394221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1c950-8adb-4cf9-9812-da07eb69a970 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.412166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 347/690] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:11.413654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129981e-aca0-432e-9737-f8f5cd8445e4 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.413957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129981e-aca0-432e-9737-f8f5cd8445e4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.414231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129981e-aca0-432e-9737-f8f5cd8445e4 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.419628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 348/691] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:11.419628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129981e-aca0-432e-9737-f8f5cd8445e4 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.437503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.439832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c4f21-bdc6-40f8-959f-228df59e41a1 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.502124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.544105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129981e-aca0-432e-9737-f8f5cd8445e4 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.583322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 344/692] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:11.585634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.586140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.586657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.589680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.590638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.591097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.591481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.601595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.603488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.607933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:11.609388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:11.621385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:11.622606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:11.623610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:11.629821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 349/693] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:11.629821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.632467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.694793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 345/694] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:11.701152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.744144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8172-f1c8-48cd-8efb-412ef8d3a91e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.775698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.785466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.789054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.789054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.789054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.799640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.801458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:11.822755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:11.823694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:11.824607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:11.824607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:11.824607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:11.824607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:11.824825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4987e-b40b-4201-bc08-7a55537c918c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.827095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 350/695] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:11.828181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.859258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.860578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.860920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.861294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.862500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:11.862614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.864170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:11.887332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 346/696] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:11.887332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:11.890619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:11.951542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa3b-ec3e-4ff4-abf5-d08ee41d0e0a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.991768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b95ad-5e31-4dba-884a-9174c337843d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:11.992622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:11.994048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:11.994554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:11.995021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:11.995865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:11.997426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:12.014182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:12.015227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:12.016887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:12.020440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 351/697] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:12.021453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.035453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.036480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.037514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.038015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.039388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:12.039898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.042284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.058359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 347/698] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:12.059248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.081437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.124964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.153024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea478d-c85e-4d69-b3b8-ec442a27d357 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.170897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214a67d-9f3f-4cca-aa13-5e31047424ae None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.204338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.205107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.205393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.206483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.220050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.220797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.221089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.221367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.222144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:12.222457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.224348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.236066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 348/699] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:12.236066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.308869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.310598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.361630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5174b-6e79-40b0-b7b9-0d749eecb369 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.362433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.391108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.399228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.400442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.400957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.401435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.409320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.411209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.424411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 352/700] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 09:04:12.425381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:12.427224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:12.428075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:12.428962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:12.431453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 349/701] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:12.432472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.538070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c36258-1257-4218-ba2b-10a8de506a87 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.542299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7fa2-05b6-48da-aad8-c21d206e352b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.577884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.577884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.578569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.578569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.579197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:12.579604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.580855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1118-23ca-4fe5-b5b1-027de82f45ba None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 353/702] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024199c8-625f-4f59-bbb5-b9e279e0e3c3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024199c8-625f-4f59-bbb5-b9e279e0e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024199c8-625f-4f59-bbb5-b9e279e0e3c3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 354/703] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:12.593813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024199c8-625f-4f59-bbb5-b9e279e0e3c3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.597948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.599107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.599406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.599686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.608115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.613238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.614792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d4ff5d73-8429-46dd-9e09-c863f757bb00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:12.634648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:12.635607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:12.636493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:12.636493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:12.636493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:12.636493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:12.640771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 350/704] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:12.643068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.643361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.643643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.663359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:12.664734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:12.704845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.727349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024199c8-625f-4f59-bbb5-b9e279e0e3c3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.757592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 351/705] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:12.757592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.791194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.791775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.792061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.792328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.793131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:12.793693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.794908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.808129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 355/706] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:12.809110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.888327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0044d4d-a9f9-4662-a6a6-a56ccfd9f345 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.923744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3b814-85c8-4ca5-b67b-9d744e7b1863 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:12.924826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.925785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.926271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.926688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.927721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:12.928245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.930006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:12.943241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 352/707] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:12.944400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:12.944686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.965890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:12.966693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:12.966976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:12.967254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:12.979800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:12.980663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:12.982163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:13.009028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:13.010060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:13.011018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:13.011018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:13.011018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:13.011018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:13.015764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 356/708] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:13.017953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.064853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccdd44-ca9b-42c0-bc79-4e4bdca19cf6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.108697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.109790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.110333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.110806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.112459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3e3e7115f88940f18234bab2425977ad) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:13.113037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.115228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.126345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 353/709] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:12 2022] GET /identity/v3/role_assignments?user.id=3e3e7115f88940f18234bab2425977ad&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:13.127496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.153588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ba6f-bd1c-4d15-b54d-db23df2dfa3f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.187402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:13.210246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.211668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.211962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.212276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.223799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.225945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-5edcf4b5-9ec2-4974-8d19-bb45d99bbbb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:13.250265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:13.251266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:13.252148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:13.260426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 357/710] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:13.260426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2e90-a1b2-4cea-b06e-db243bae51a7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.260426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2e90-a1b2-4cea-b06e-db243bae51a7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.260426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2e90-a1b2-4cea-b06e-db243bae51a7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.262345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 358/711] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:13.263176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2e90-a1b2-4cea-b06e-db243bae51a7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.292737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:13.302736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec919-f61a-4de9-9287-c1a4a49de5e7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.352938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.353986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.354478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.354954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.355880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:13.356410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.358025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdb503-f7ef-414c-b205-c856983e96a0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.372356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 354/712] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:13.374717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.377134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.377134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.394784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:13.395978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2e90-a1b2-4cea-b06e-db243bae51a7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.396090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:13.437412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.438595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.439868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.439868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.440661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:13.440978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.442629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.457645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 359/713] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:13.458242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.489805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 355/714] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:13.490695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.533146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:13.607787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:13.620880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519b69-eaec-4361-bd96-70fbad5156fc None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.625048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056021-4ca0-4d50-9658-7bc8b861cd0e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.670873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.671538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.671877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.672228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.673069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:13.673389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.674613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.674890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.675709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.676191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.676930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.678434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.680379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.681056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 356/715] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:13.681924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:13.816809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 360/716] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:04:13 2022] POST /identity/v3/users => generated 254 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:13.829067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f088bd-587b-4ded-921a-97823b60adaa None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:13.870009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:13.871185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:13.871671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:13.872160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] PATH_INFO: `/v3/services/network` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:13.873032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:13.874714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:13.894331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:13.895869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:13.896741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:13.904525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 357/717] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:13.907305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:14.039709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:14.047309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0542d-7dd3-40f5-9ba3-af46ec23dfd2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:14.095868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:14.096926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:14.097409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:14.097961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:14.098894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] RBAC: Adding query filter params (name=network) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:14.099416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:14.101000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e7938-0f7c-4efc-9de5-edc93f01227b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:14.111106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 361/718] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:14.117132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:14.150339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:14.260482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498b0c-9365-453e-b56a-532a8021e826 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:14.298190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:14.299233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:14.299747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:14.300228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:14.301152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] RBAC: Adding query filter params (type=network) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:14.301744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:14.303369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7dccd-68e1-45e2-8cfa-2961fa7b7982 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:14.313968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 358/719] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:14.981555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440225-c415-4669-b640-3a30a518f0a2 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:14.982128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440225-c415-4669-b640-3a30a518f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:14.982128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440225-c415-4669-b640-3a30a518f0a2 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:14.983883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 362/720] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:14.990478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9ee4-d4cf-4967-a5d5-21c425a052e2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:14.990960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9ee4-d4cf-4967-a5d5-21c425a052e2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:14.991065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9ee4-d4cf-4967-a5d5-21c425a052e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:15.013707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-83ae9ee4-d4cf-4967-a5d5-21c425a052e2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:15.014923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-83ae9ee4-d4cf-4967-a5d5-21c425a052e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:15.112496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 359/721] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:04:15.136640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440225-c415-4669-b640-3a30a518f0a2 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:15.271898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440225-c415-4669-b640-3a30a518f0a2 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:15.330189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:15.330877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:15.331161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:15.331438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:15.332165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:15.333546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e8d1-e1b0-4030-8de6-631fbcd2f6e0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:15.435177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 363/722] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:15 2022] POST /identity/v3/services => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:04:15.654540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216b1e-70a3-4116-97e7-a863f3ce94f8 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:15.654905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216b1e-70a3-4116-97e7-a863f3ce94f8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:15.655169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75216b1e-70a3-4116-97e7-a863f3ce94f8 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:15.656945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 360/723] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:15.663577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:15.663874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:15.664285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:15.690917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:15.692182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:15.713641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:15.785721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 364/724] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:15.810461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75216b1e-70a3-4116-97e7-a863f3ce94f8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:15.821011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:15.933261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75216b1e-70a3-4116-97e7-a863f3ce94f8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:15.989962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:15.991109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:15.991969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:15.992426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.008272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:16.017050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:16.018217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:16.019245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:16.025745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 361/725] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:16.030688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.163717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b7551-bb23-4b8a-b423-b102d05a6337 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.206367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.207106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.207389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.207666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.208426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:16.208733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:16.210143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48506c6-23ab-436b-be64-9a5fc959ba0f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:16.219708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 365/726] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:16.230856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.271751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01ecc-a4a4-42b9-9850-0f95a2c3ff88 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.272076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01ecc-a4a4-42b9-9850-0f95a2c3ff88 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.272308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01ecc-a4a4-42b9-9850-0f95a2c3ff88 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.273688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 366/727] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:16.284491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.284793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.285064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.331463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:16.332678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:16.334981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:16.342657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:16.422360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 367/728] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 09:04:16.434066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aaec7-3e0b-44a0-b581-01a95cd8c40c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.450367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.499344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.500106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.500391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.500850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.527765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:16.529234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:16.568849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3475-af98-4b0a-ad73-e44fd2f885c6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:16.570767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:16.571652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:16.572553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:16.572553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:16.572553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:16.572553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:16.572553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 362/729] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:16.577470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.609024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.610212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.610565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.610887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.619088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:16.623988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:16.633422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:16.636103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:16.637137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 368/730] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:16.648072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.729438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc742516-a3b2-4c56-8033-8b2fcb40e52b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.751974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:16.774299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.774975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.775262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.775539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.776402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:16.779453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:16.780868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:16.807199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 363/731] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:16.813734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.845985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b961f-ce01-49ba-8edf-b6d214457907 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.901362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.902207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.902494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.902770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.903526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:16.903832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:16.905329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a2e8b-cebb-4086-833f-14889a930dd5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:16.919647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 369/732] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:16.921051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc83c-d875-49ee-8664-864b5fe5328d None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.921340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc83c-d875-49ee-8664-864b5fe5328d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.921644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc83c-d875-49ee-8664-864b5fe5328d None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:16.923437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 370/733] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:16.924143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc83c-d875-49ee-8664-864b5fe5328d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:16.956748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594c3c1-467d-461f-b386-22ede7b4990d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:16.993451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:16.994286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:16.994576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:16.994684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:16.994853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.003181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.004860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4784f7cc-10bc-49a5-a53f-e60c74ccb38d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:17.020562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:17.021631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:17.023056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 364/734] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:17.023650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086e643-45b1-49cf-90f9-b921f6f4310d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.023650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086e643-45b1-49cf-90f9-b921f6f4310d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.023771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086e643-45b1-49cf-90f9-b921f6f4310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.041473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e086e643-45b1-49cf-90f9-b921f6f4310d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:17.042708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e086e643-45b1-49cf-90f9-b921f6f4310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:17.048194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc83c-d875-49ee-8664-864b5fe5328d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.074316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.088877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.089822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.090112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.090392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.106296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.107743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.117623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 365/735] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:17.117623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53269d5d-6e23-4157-9ae3-408a28f515ff None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.117623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53269d5d-6e23-4157-9ae3-408a28f515ff None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.117936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53269d5d-6e23-4157-9ae3-408a28f515ff None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.119205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 366/736] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:17.123740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53269d5d-6e23-4157-9ae3-408a28f515ff None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8d3d93fc-6e48-4836-9074-ccc78bff6c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:17.134408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:17.135595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:17.136647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:17.136647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:17.136647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:17.136647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:17.138336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 371/737] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:17.140011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976d87-7444-45e5-a700-012b412598ce None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.140480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976d87-7444-45e5-a700-012b412598ce None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.141675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976d87-7444-45e5-a700-012b412598ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.161084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-89976d87-7444-45e5-a700-012b412598ce None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:17.162314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-89976d87-7444-45e5-a700-012b412598ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:17.235648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 372/738] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 09:04:17.238475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976d87-7444-45e5-a700-012b412598ce None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.245026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53269d5d-6e23-4157-9ae3-408a28f515ff None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.283086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.284098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.284585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.285088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.286156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:17.286760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.288311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.289054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.315651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 367/739] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:17.315651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.342202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.372869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976d87-7444-45e5-a700-012b412598ce None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.413382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.414516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.414866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.415144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.415867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:17.416174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.417546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.426921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea907c-bef3-4165-a776-b240ec32840b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.429997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 373/740] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:17.435242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.463903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.464573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.464854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.465132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.465963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.467372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.547540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 368/741] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:17 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:17.548338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.549437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96572354-c4d4-4b30-8e2c-94fab62501af None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.551903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.605921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.607046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.607456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.607803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.621938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:17.630561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:17.631837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:17.632671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:17.637674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 374/742] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:17.638897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.770484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f87d9-fd3a-46a0-b470-253359da7f0c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.801691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.814772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.815992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.817289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.817289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.823010 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db204db-9415-4c64-9894-330c19ba0645 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:17.830917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.832783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:17.849476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:17.850500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:17.851472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 375/743] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:17.852067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:17.869302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:17.870205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:17.870889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:17.871328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:17.877089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:17.962225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:17.964367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:17.985486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d28d9-f678-4e2c-ace8-35757317b526 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.023050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.023733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.024018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.024296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.025047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:18.025356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.026909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.037144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 376/744] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:18.042583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.060680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.084015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 369/745] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:18.085340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.134866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.156749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cb3be-d93a-4ac3-b576-de12f80e19ba None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.194721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.195404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.195690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.195966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.196578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c2e5-e3fe-4808-b4d0-1efdf7224b43 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.196837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:18.197148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.198712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.222174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 377/746] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:18.222174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.235819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.236630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.236920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.237355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.250713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.252202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-607eacfd-0a11-4715-ae9f-b8ef32dc57f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:18.271912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:18.272873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 370/747] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:18.274594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47feb3-f184-493a-bb62-5f4e17fb86e7 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.275009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47feb3-f184-493a-bb62-5f4e17fb86e7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.275009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47feb3-f184-493a-bb62-5f4e17fb86e7 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.280246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 371/748] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:18.280246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47feb3-f184-493a-bb62-5f4e17fb86e7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.320827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.356359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809411f-4aa0-4afd-95c9-1e2a0a4baa53 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.388861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47feb3-f184-493a-bb62-5f4e17fb86e7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.398091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.399031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.399233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.399464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.406959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.411039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.412332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.429833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-dbb878c6-e96e-4103-8d89-1ae7e2738601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:18.430447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:18.431330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:18.433110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:18.433110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:18.433110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.433110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:18.433334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.433334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.433334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.433524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 378/749] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:18.433524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.433524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.433932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.448385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.449874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.451181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:18.452355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:18.471698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:18.472685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 372/750] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:18.474349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.529201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 379/751] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:18.530083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.618671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.628291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d606-9d34-478c-9507-3c89725178c7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.665960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.665960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.665960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.666333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5216322-6bff-4f1f-9923-db19f2ce7ee5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.666411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.666763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:18.667063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.668427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.684105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 373/752] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:18.684105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.692535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.709414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.710298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.710624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.711187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.712194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:18.712509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.714398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.735275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 380/753] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:18.735275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.791545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76fd0-af51-418c-8789-1b9a8ff482ef None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.829748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.830776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.831230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.831495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.832263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:18.832630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.834112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.852388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 374/754] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:18.852388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.858275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610097-bc52-410f-86e1-928bc1d37fb5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:18.863348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.897643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:18.898390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:18.898671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:18.898945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:18.899591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:18.901000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:18.914927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:18.916072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:18.916927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 381/755] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:18.917813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:18.966203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:18.966674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f1c6-309e-43b1-84c8-906ed27c7daf None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.004172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.004997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.005271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.005543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.013876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.015315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.022972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b7904-7e7d-4a6a-9857-338e78d3dd28 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:19.032683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:19.033756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 375/756] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:19.034795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.063955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.064727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.065014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.065482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.073405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.074898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:19.089907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:19.090863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:19.091769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 382/757] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:19.092255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.116206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.152189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c59c8-1537-46fc-9226-1b987bc12f5a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.190489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.191292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.191598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.191895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.199763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.201406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:19.217530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:19.219473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:19.221467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:19.223679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 376/758] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:19.224508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.253466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566ab91-330e-4c65-8e36-1c02c1d87fb7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.259423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.295437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.296288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.296550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.296860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.297681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.298037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.301548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.309122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 383/759] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.310233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.338885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40bb5-4762-431d-abfc-2be124a54523 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.372415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.380630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.385745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.407389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 377/760] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.408236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.427514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3701-3f73-407e-8b76-d43eb26b3d53 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.463743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.464415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.464708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.464980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.465797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.466122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.467553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.480998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 384/761] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.481839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.512467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.521229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc0a1b-356e-49e5-8667-74c9c2cf9ae9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.557644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.558313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.558602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.558881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.559670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.559984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.561427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.578874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 378/762] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.578874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.592913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713c54-ef98-4a2d-b653-0b554292a71a None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.629263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.629506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.629682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.629969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.630250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.630968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.631276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.633010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.643409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 385/763] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.643409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.691065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edd660-4c01-411c-94d9-eaaadafdfce6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.727752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.728552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.728983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.729366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.738460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.748070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f989fe-3686-4e1b-b261-0f82b0d9ca16 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.786684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.787556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.788214 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.788498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.789335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3e3e7115f88940f18234bab2425977ad) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:19.789689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.791134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.796689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 386/764] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/role_assignments?user.id=3e3e7115f88940f18234bab2425977ad&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:19.797495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.804982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.806508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:19.860357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:19.915643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1a92-5a77-4c4e-a325-62f8f3eee3cf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:19.916027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 379/765] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:19.916889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:19.967340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:19.968165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:19.968444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:19.969244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:19.973653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=923ba7b9f0414b6e8d9a3ad4cb256ebf, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:19.975103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ceb03-e780-4652-affb-1101f8aafd40 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.041697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618139-f036-4d3a-b24c-30f356c7dd5f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.070430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 387/766] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:19 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:20.073049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48bc7-8d20-4ebd-ab84-bd187086b022 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.073669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48bc7-8d20-4ebd-ab84-bd187086b022 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.074194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48bc7-8d20-4ebd-ab84-bd187086b022 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.076146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 388/767] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:20.076915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48bc7-8d20-4ebd-ab84-bd187086b022 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.092375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.093284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.101815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.101815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.101815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] RBAC: Adding query filter params (interface=public, service_id=d5ad88a4cf88417587ce15c1a02ea6e0, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:20.101815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.101815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40def539-e754-4491-a776-178e4fd0cbfc None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.110676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.116338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 380/768] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:19 2022] GET /identity/v3/endpoints?service_id=d5ad88a4cf88417587ce15c1a02ea6e0&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:20.118115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.118499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.118790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.142249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:20.143485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:20.155117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.227242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48bc7-8d20-4ebd-ab84-bd187086b022 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.249718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 381/769] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:20.251329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.279023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.280696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.282810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.283324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.297339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.299241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:20.332349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:20.333491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:20.334630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:20.334630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:20.334630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:20.334630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:20.336002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 389/770] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:20.337261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.387933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac83a-48d0-4e85-8ba9-8ac52e63c921 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.425946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.441447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.442442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.442733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.443019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.443891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.445686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.453425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 382/771] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:20.454671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.461490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d920-9727-4a29-bb27-414eb719fbef None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.467148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.504009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.505198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.505746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.506224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] PATH_INFO: `/v3/services/network` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.507634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.510486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:20.524372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:20.525428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:20.526572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:20.529660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 390/772] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:20.535754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.644776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056564c-f5c3-43f7-a9b9-d21f129ae1fe None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.691779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.692522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.692807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.693136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.693909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:20.694281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.695613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.710902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 383/773] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:20.716226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.723715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873bcb-1896-4a74-8257-395531946e0b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.767183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.777960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:20.778629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:20.778914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:20.788641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:20.788641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] RBAC: Adding query filter params (name=network) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:20.788641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:20.788641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:20.788641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 391/774] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:20.796047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:20.827430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:20.901864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22141069-5ab3-4638-a0bb-c7ffc9bb6776 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:20.962426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f562-23de-4311-8492-d4df7f67affa None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:21.002020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.002703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.002983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.003257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.004069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:21.004378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.005787 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.011872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.012051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 392/775] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:21.012650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.012935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.013210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.018304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:21.030899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.033140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:21.069953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:21.070923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:21.072260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 384/776] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:21.077248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:21.096792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:21.147891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0118-2454-4da6-b364-ea8a2e70bdb2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:21.223265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.223943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.224224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.224498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.225293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] RBAC: Adding query filter params (interface=public, service_id=b1444df5760d4d0ab10404295b0fbcea, region_id=RegionOne) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:21.225625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.227005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.246224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 393/777] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:21 2022] GET /identity/v3/endpoints?service_id=b1444df5760d4d0ab10404295b0fbcea&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:21.252870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:21.286325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4718b-c828-455d-ba06-186bb736b267 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:21.330377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.331161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.331458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.331742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.332539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:21.332971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.333443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:21.336124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.349419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 385/778] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:21.360885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:21.447303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a49031-e4df-4281-a17e-4fcf8dbd5922 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:21.475497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:21.490200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.490958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.491244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.491520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.492217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.493766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b388b-a9b2-4d03-986a-1119dfbf419b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.500859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 394/779] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:21 2022] GET /identity/v3/services => generated 772 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:21.569037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbb5f8-e34e-4e5d-8217-981c031cc4d4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:21.622516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:21.623210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:21.623498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:21.623778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:21.624646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=92ec739cd04543e4b75886c851ef9412) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:21.625787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:21.627286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad62a1-620a-4608-8010-b834b8124684 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:21.634306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 386/780] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:21 2022] GET /identity/v3/role_assignments?user.id=92ec739cd04543e4b75886c851ef9412&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:22.007255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbaaa-c943-40d9-99d3-630a2b99274d None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.007603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbaaa-c943-40d9-99d3-630a2b99274d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.007780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbaaa-c943-40d9-99d3-630a2b99274d None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.009342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 395/781] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:22.015118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.015583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.015820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.039048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:22.040256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:22.107780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:22.135259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 387/782] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:22.170172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbbaaa-c943-40d9-99d3-630a2b99274d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:22.307039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbbaaa-c943-40d9-99d3-630a2b99274d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:22.347674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:22.349040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.349609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.350080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.366391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:22.376719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:22.379149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:22.381102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 396/783] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:22.386720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:22.556551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c29fb-3473-4f46-8ea3-22ac087d8080 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:22.612139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:22.612750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.613035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.613313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.614111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:22.614421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:22.615807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82c1d-7f64-480f-81eb-8ed8b38113da None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:22.629267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 388/784] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:22.635382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:22.728113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:22.754937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d76bb-0216-43cc-a99a-59f510e55630 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.755253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d76bb-0216-43cc-a99a-59f510e55630 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.755565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d76bb-0216-43cc-a99a-59f510e55630 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.757435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 389/785] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:22.766956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.767422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.767855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.802373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fb8fe-0742-43a8-a856-d0fac7ee404b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:22.808025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:22.809242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:22.842768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:22.845848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:22.846567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:22.848338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:22.871864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:22.873882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:22.889919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:22.905113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:22.907031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:22.908504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:22.908504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:22.908504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:22.908504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:22.908504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 397/786] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:22.914977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:22.986855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 390/787] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:23.066259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.074866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.079040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e0c8-ef18-4915-b8b4-58921b388153 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.154544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.155151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.155435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.155713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.157113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:23.157471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.159004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.183136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 398/788] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:23.190983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.282279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b9b6b-a1a9-4bf2-b611-e71d7b3acac2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.329084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.329942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.330221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.330496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.340989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d5368402-b116-4067-8ff2-a88194c2f6b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:23.349489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:23.350549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:23.351738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 391/789] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:23.352651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ef29-7523-455e-96a4-acfd1f3095ad None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.352651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ef29-7523-455e-96a4-acfd1f3095ad None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.352651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ef29-7523-455e-96a4-acfd1f3095ad None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.355372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 392/790] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:23.356390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ef29-7523-455e-96a4-acfd1f3095ad None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.379757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749886c-777f-4d6f-a1be-90dc7e06aabf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.392798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.424236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.425279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.425858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.426138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.436090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.438392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-55e68057-89ae-4550-bd65-188d40ddb048 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:23.456871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:23.457969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:23.459236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:23.461756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 399/791] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:23.462916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.463273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.463554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.479794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ef29-7523-455e-96a4-acfd1f3095ad None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.486589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:23.487932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:23.507335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.519787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.520467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.520751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.521034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.521838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:23.522149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.523654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.538454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 393/792] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:23.539501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.571362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 400/793] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:23.572236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.669389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.678475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd5530-1736-4648-ae22-815a87780295 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.696748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62b30-dd77-4b51-878f-182fd197e843 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.725938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.726640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.726928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.727206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.728224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:23.728536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.730648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.737762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.738794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.739227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.739651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.751277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.753004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.757760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 394/794] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:23.758648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:23.776247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:23.777412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:23.778370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:23.778370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:23.778370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:23.778370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:23.785286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 401/795] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:23.786597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.790125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.905357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061633f4-2d61-454d-b3f7-d60e35813c59 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.906155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63c3be-e741-45e2-baf9-24c5b3db183e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.944844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.945928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.946470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.946992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.947921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.949250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.949765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.950089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.950376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.950755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.963375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:23.964578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:23.965723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 09:04:23.966748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:23.967739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.975138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 395/796] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:23.976353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:23.988985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:23.990599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:23.992233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:23.992233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:23.992233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:23.992233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:23.995425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 402/797] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:23.996745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.005509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.065180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.114949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acf77-0a0d-4e7d-b7cc-11acdeec23ad None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.116657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3aa1-9c3c-492d-ae33-f794cceb4809 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.153989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.154683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.154939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.155214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.156489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:24.156910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.158019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.158777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9353-e82f-40eb-875c-569e507f2f2c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.159046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.159482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.159906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.160762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:24.161217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.162790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.171536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 396/798] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:24.173753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 403/799] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:24.174851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.178065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5972-3348-44be-8966-9eb1a45f13f9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.178394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5972-3348-44be-8966-9eb1a45f13f9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.178690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5972-3348-44be-8966-9eb1a45f13f9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.180134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 397/800] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:24.181000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5972-3348-44be-8966-9eb1a45f13f9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.273430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.279959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6313aa-3d78-4749-aa61-1c62e39726fc None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.298662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5972-3348-44be-8966-9eb1a45f13f9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.298855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.317415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.318086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.318364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.318633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.319348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:24.319652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.321034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39976a-242d-4152-94d3-48e0aa9011a3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.332894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 404/801] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:24.334251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9608-3669-4021-8afc-c4199114d007 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.334539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9608-3669-4021-8afc-c4199114d007 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.334808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9608-3669-4021-8afc-c4199114d007 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.335642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.336455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.336702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.336980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.340225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 405/802] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:24.340918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d9608-3669-4021-8afc-c4199114d007 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.345546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.347023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7ba1dc6b-4396-42d8-86fd-c68e443f40d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:24.361771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:24.362767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.363705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 398/803] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:24.364285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.364508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.365448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.380981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:24.382449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:24.448034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d9608-3669-4021-8afc-c4199114d007 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.449882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 399/804] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:24.450728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.483498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.484591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.484857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.485135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.485876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:24.486230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.487546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59721385-4485-408e-8603-f8a8d9b472d4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.492302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 406/805] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:24.494771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.494771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.494771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.510669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:24.511868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:24.529457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.548834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.556720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d86cb6-e87b-44c1-90f8-45e63ff8c67d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.579178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 407/806] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:24.580011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.606716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.607545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.607834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.608102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.614881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.616317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:24.629770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:24.630842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 400/807] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:24.632037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.687222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c775-ee5e-4159-ac7e-159bf2990a28 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.726602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.727272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.727536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.727809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.728631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:24.728933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.730377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.739132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe9f57-0e27-4032-a12d-60f960ea15ae None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.747178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 408/808] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:24.747950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.764562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.774481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.776924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.776924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.776924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] PATH_INFO: `/v3/services/network` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.776924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.778067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.778575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:24.790920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:24.791902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.792737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 401/809] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:24.793528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.850792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775f9b4-879a-4da4-bb1e-22b003f6d24f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.884842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.885495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.885808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.886081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.886819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:24.888175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:24.896318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822b2d-a03a-4a7a-bea4-d8f285d3817d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.930700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.931497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.931781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.932058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.942031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:24.949717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:24.950813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:24.951776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 402/810] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:24.952715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.994490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 409/811] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:24.995429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.005922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.061582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63505-641a-4142-8775-1c0f28ea0174 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.106206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.108462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.109780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.110159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.110334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.111142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:25.111445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.112925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.123592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88400-6aa1-4c0d-83f9-31bf9a47de1b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.126798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 403/812] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:25.127668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.167790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.168453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.168736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.169012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.241327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0645806-aec3-4857-a3b4-c3c5f33f433e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.245791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.247476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.248351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.282231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.282911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.283199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.283479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.284190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] RBAC: Adding query filter params (name=network) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:25.284502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.285901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.294969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 404/813] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:25.294969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.404591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d846-ff8a-4d46-b1cb-4c8deb1089ef None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.444278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.444962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.445248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.445529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.446327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:25.446639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.448030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.462969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 405/814] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:25.462969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.466320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.483030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 410/815] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:25.483931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.501472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.574224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960e783-6289-4464-8ff2-094787d9782d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.594573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1875e3-bbd2-4975-aa90-5c5172dfab1c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.611968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.612865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.613159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.613432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/3e3e7115f88940f18234bab2425977ad/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.615435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=3e3e7115f88940f18234bab2425977ad, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.616866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.631348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.632206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.632483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.633056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.633434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:25.633769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.635134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.639955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 411/816] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:25.641338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.691164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 406/817] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:25 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/3e3e7115f88940f18234bab2425977ad/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:25.693077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.695688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.760470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac933-9dc8-4b80-af61-024abc1281c9 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.810043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.811529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.812609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.813219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.822169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:25.829986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9145-2c75-494c-9804-d2b345a8d838 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:25.832306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.832834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:25.856204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:25.857340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:25.860007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:25.860007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:25.860007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:25.860007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:25.860007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 412/818] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:25.860306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:25.891624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:25.892231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:25.892519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:25.892796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:25.907394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.909806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:25.930484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:25.931436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:25.932325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:25.932325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:25.932325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:25.932325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:25.932325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 407/819] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:25.933052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.012408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1825df2-7e13-4faf-bcd1-40a97d2e90df None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.015676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.056262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891c0b-4eb8-4268-9dcf-e21115c5ed05 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.061685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.062470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.062750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.063186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.064479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.065887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.093826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.094840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.095125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.095406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.096296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.096601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.098005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.110906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 408/820] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:26.112019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.118155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.153821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 413/821] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:26.153821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.305266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061be0-e283-4be6-8de2-65c3243ea389 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.344839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.345904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.346196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.346469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.350256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d23fd4-8ae4-4be5-b704-9fa06be91f7a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.357126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.358159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:26.374293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:26.375953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:26.381919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 414/822] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:26.387251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.402501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.403742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.404123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.404497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.406330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.407325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.409077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.410383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.428235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 409/823] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:26.433995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.506817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.508382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f8f6-8efd-4ca1-942c-6796436c0d0f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.546153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.547824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.548346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.548826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.549588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7412-feff-4ef8-b6d5-1c0a203ee30f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.550124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.550627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.555720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.575623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 415/824] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:26.577192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.588826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.589417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.589823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.590167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.599835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.601642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:26.621907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:26.622847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:26.624019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 410/825] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:26.629851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.663638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.701770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766751f-7ee5-4f86-87de-5ba8ee4bf5c0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.744790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd7c12-5e8d-441c-b477-8be9ec75523e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.750330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.751502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.751985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.752430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.766847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.769553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.772939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.785340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.786129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.786497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.786877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.787732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.788112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.789648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:26.793119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:26.794059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:26.794954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:26.794954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:26.794954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:26.794954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:26.802032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 416/826] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:26.805090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.809282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 411/827] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:26.815638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:26.930490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4aaef7-51a4-4d79-86a8-a780bf6dcdc1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.936608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c50b-5918-4801-b543-1799480e96ac None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:26.964952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:26.969676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.970365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.970647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.970920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.971757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.972072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.973633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.981996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:26.982673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:26.983425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:26.983737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:26.985264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:26.985600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:26.987090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 417/828] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:26.987219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f9cbf-1e88-4262-9a24-3175f100cb67 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:26.993935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 412/829] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:26.998815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.112846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a637db-e57a-45b9-8394-1f22a452e3ce None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.151612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.152808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.153294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.153800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.161958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.163987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:27.180496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:27.181435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:27.182573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:27.183161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd3cd-6b31-4b26-beaa-4d65c870b5ad None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.183161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd3cd-6b31-4b26-beaa-4d65c870b5ad None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.183161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd3cd-6b31-4b26-beaa-4d65c870b5ad None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.183161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 413/830] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:27.184794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 418/831] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:27.189000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.189390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.189770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.191107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.215281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:27.216507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:27.248236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:27.271720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:27.303653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 414/832] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:27.318368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f6726-f89e-44ca-a0ee-05672797e16c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.326978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.377704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.379305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.379801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.380481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.382223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:27.383199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.385573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.403466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 419/833] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:27.410227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.453151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ba25-46b2-4481-9e43-e0a747f87a0f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.489921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.491104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.491593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.492086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.492958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.494681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:27.508735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:27.510452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:27.511281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:27.514118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 415/834] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:27.521100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.524501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb307d6-3237-4ae5-babe-d42ea832476e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.527086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:27.564564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.566286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.566589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.566920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/92ec739cd04543e4b75886c851ef9412/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.570405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:27.584980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=92ec739cd04543e4b75886c851ef9412, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.586464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef60f9a-27d8-4824-8c22-37d7e585dd4d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.630339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738c6c9-2d94-4b06-9828-1aea7a26f9a3 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.666042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.666697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.666985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.667263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.667965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:27.668275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.669666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.674834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 416/835] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:27.680073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:27.703278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 420/836] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:27 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/92ec739cd04543e4b75886c851ef9412/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:04:27.808951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d8ef-2bd8-4ff4-b842-355db93de2f0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:27.818137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:27.849781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:27.850481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.850772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.851053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.851783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:27.852099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:27.853515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477401-f096-4889-86b5-9706cf0a86d8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:27.859813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 417/837] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:27.939221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8564-5d22-41a9-b143-42f8bd88cc6b None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.939748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8564-5d22-41a9-b143-42f8bd88cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.939748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8564-5d22-41a9-b143-42f8bd88cc6b None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.941417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 421/838] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:27.947332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:27.947626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:27.947908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:27.966293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:27.967506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:28.044199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 418/839] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:28.068363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8564-5d22-41a9-b143-42f8bd88cc6b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:28.178601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8564-5d22-41a9-b143-42f8bd88cc6b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:28.216590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:28.217726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:28.218262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:28.218717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:28.230859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:28.239848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:28.240813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:28.241730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:28.244112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 422/840] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:28.250779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:28.353229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:28.356027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9d4a-c67e-47de-8b42-676b00455411 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:28.392541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:28.393216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:28.393508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:28.393830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:28.394586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:28.394901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:28.396294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:28.405281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 419/841] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:28.411545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:28.429393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:28.523641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29428b25-61dc-4801-b672-f064fb29a108 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:28.560968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:28.561905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:28.562154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:28.562425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:28.573100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:28.574586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:28.593811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:28.594915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:28.595800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:28.595800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:28.595800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:28.595800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:28.595800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 423/842] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:28.600906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:28.708602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f16d9-c568-4640-bc84-2afea077a104 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:28.751359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:28.752029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:28.752313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:28.752591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:28.753312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:28.753645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:28.755016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:28.767775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 420/843] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:28.773017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:28.843588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:28.882136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6cb52-79f8-42e2-8894-360d704eec51 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:28.920167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:28.921022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:28.921437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:28.921968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:28.931074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:28.932550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:28.948485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:28.949948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:28.950925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 424/844] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:28.956832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.006291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.066814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa661d-0bde-4aac-b4dc-8752f5e3fb25 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.107155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.107772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.108057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.108333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.109744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:29.110068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.111537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988bfc-6aef-43aa-9365-f626dfaa4e89 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.130594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 421/845] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 21 09:04:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:29.136204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.244221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e186497-f770-4e82-a2c1-65eb49f49d30 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.271254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.278740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4dc0b-f29d-4e12-ab6e-768debf49ced None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.279032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4dc0b-f29d-4e12-ab6e-768debf49ced None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.279308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4dc0b-f29d-4e12-ab6e-768debf49ced None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.280690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.281342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.281654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.281932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.284440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 422/846] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:29.285928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.286213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.286490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.315621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:29.316985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:29.362422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.364422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.393937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 423/847] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:29.410279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.428829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.537004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 425/848] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:29.539386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.578603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ceef1-ec99-4a18-b852-c353ceb38f49 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.589784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.638287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.640373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.640948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.641438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.642858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.644559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:29.661252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:29.662445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:29.663460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:29.666442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 424/849] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:29.674132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.706627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035fb86-4df6-48ae-b7a6-d7a68a830604 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.744433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.745606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.746071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.746525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.757669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.759389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:29.777866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:29.778796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:29.779740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:29.779740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:29.779740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:29.779740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:29.781270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.783164 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 426/850] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:29.788354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.819433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b964ba-8802-486f-b581-6d1a3772046c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.867598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.868630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.869177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.869704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.870619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:29.871131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.872710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.875117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:29.879617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 425/851] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:29.884913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.908026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b91-fcbf-4815-b2ea-51161b67a983 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:29.952482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:29.953304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.953477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.953782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.954508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:29.955023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:29.956387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568adba-7eed-4a6b-9897-203c4b72024b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:29.972396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 427/852] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:29.973865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b7fa-18df-491f-8038-49ec96e7c3b5 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:29.974159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b7fa-18df-491f-8038-49ec96e7c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:29.974431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b7fa-18df-491f-8038-49ec96e7c3b5 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:29.975860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 428/853] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:29.976375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b7fa-18df-491f-8038-49ec96e7c3b5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:29.999121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4241ab-21c4-418b-b611-4a4908e5e59b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.036806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.037479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.037799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.038077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.038791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:30.039129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.040472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee27f4e-fc12-4df6-94be-1aa437d75cb7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.045150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 426/854] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:30.046876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c731-ddda-4cf1-acbe-652ed3a0fc1b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.047167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c731-ddda-4cf1-acbe-652ed3a0fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.047443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c731-ddda-4cf1-acbe-652ed3a0fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.053378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.067557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4068c731-ddda-4cf1-acbe-652ed3a0fc1b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:30.069595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4068c731-ddda-4cf1-acbe-652ed3a0fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:30.104738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b7fa-18df-491f-8038-49ec96e7c3b5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.145342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 427/855] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:30.146466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.146851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97448-ec09-42d9-bf33-ef9238be8508 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.147152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97448-ec09-42d9-bf33-ef9238be8508 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.147433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97448-ec09-42d9-bf33-ef9238be8508 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.148161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.148637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.148740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 428/856] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:30.149243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.154188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.154480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.154766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.163794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.165619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.167906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.176451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:30.177721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:30.185082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:30.186086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 429/857] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:30.187936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.269861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 429/858] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:30.270664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.311195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c318-2603-494b-947e-411f65abe93d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.345622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.348937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.349781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.350062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.350335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.364680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:30.372630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:30.373623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:30.375602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 430/859] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:30.376360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.394623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f40e6-82ef-47d2-967d-47d4b93b1a88 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.433416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.434026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.434319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.434582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.435367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:30.435679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.437252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.437836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.454201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 430/860] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:30.454201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.489918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cb26d-081c-4a14-8a1f-1e7db883cb72 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.525908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.526577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.526882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.527177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.527901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.529430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.562754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3cea-e919-473d-8e00-bb480c855e41 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.585464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.597188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.597889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.598304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.598523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.599269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:30.599582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.600962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.609553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 431/861] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:30.611399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.634668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 431/862] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:30 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:30.635514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.757961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb06d-c2d0-4e04-8198-b5ed8b4a1502 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.786513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2113a-2bd8-41b0-83e5-1e4ae51e97e0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:30.804377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.809304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.810284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.810566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.810840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.811746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=3e3e7115f88940f18234bab2425977ad) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:30.812917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.814847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.822336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 432/863] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/role_assignments?user.id=3e3e7115f88940f18234bab2425977ad&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:30.830675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:30.831286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:30.831581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:30.831861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:30.845244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:30.846848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:30.867695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:30.868704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:30.869721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:30.869721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:30.869721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:30.869721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:30.869721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 432/864] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:30.876236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:30.937900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:30.989175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352aff8-22db-4de5-ad00-fe1182ace355 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:31.026754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:31.027354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:31.027639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:31.027914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:31.028646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:31.028951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:31.030425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:31.043940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 433/865] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:31.049629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:31.159860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414cddc-63ee-4894-a95d-58b59a768404 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:31.201888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:31.203559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:31.203988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:31.204266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:31.212862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:31.214534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:31.230572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:31.231559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:31.232515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 433/866] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:31.238873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:31.356931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103fe42-7bae-4676-b375-28f66e8fda21 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:31.366798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:31.394149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:31.394828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:31.395114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:31.395394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:31.396237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:31.396549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:31.398017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:31.421098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 434/867] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:31.426623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:31.457728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:31.539262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8672c-3a02-4997-8d9c-334eb9c797e0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:31.575887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:31.576867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:31.577433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:31.577966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:31.651912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:31.653777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:31.682501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:31.765945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 434/868] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:31 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:31.768987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:31.875798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2117cb-b763-4fa6-833d-b20da64eb1f7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:31.912634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:31.913429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:31.913746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:31.914021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:31.925107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:31.926643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:31.944315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:31.945227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:31.946324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:31.946324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:31.946324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:31.946324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:31.946324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 435/869] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:31.952898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:32.055527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe943c1-20f1-41db-b05c-10aa998fdef6 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:32.082596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:32.091957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:32.093615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.094129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.094643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.095622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:32.096093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:32.097644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b89f8-b495-4096-9ba9-dd52e7d2e0d9 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:32.114982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 435/870] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:32.116724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:32.126275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97caa8-b571-464e-88d6-0a3f48420a52 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.126907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97caa8-b571-464e-88d6-0a3f48420a52 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.127391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97caa8-b571-464e-88d6-0a3f48420a52 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.129425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 436/871] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:32.135487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.136099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.136573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.149950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:32.154443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:32.156287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:32.237585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 437/872] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:32.254474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afc86-9fd9-4288-8992-b3688a5652de None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:32.258184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:32.313044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:32.313888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.314175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.314452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.321640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:32.323160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:32.337839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:32.338752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:32.339644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:32.345095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 436/873] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:32.345947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:32.388496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceda1a-6d24-49cc-a56e-2f65ad22ad2a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:32.411266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:32.431045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:32.434738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:32.435783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.437126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.437615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.438968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:32.441032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929de5b-6716-4103-8bdc-37a62015f729 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:32.457481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d5b4b-04ea-4677-9b2e-4b22647c79ca None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:32.496173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:32.496875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.497163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.497491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.498382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:32.498702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:32.501192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:32.523249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 437/874] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:32.538901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:32.598884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 438/875] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:32 2022] POST /identity/v3/services => generated 269 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:04:32.659786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0352-d08c-497c-a970-96abb5cddaa9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:32.706060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:32.706734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.707077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.707357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.708256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=92ec739cd04543e4b75886c851ef9412) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:32.708619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:32.710127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e070a0a-4380-442a-846c-1d38c7bc4f34 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:32.712312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:32.718545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 438/876] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:32 2022] GET /identity/v3/role_assignments?user.id=92ec739cd04543e4b75886c851ef9412&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:32.852783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268dff-9178-4435-bd83-ea877656ba76 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.853093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268dff-9178-4435-bd83-ea877656ba76 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.853339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2268dff-9178-4435-bd83-ea877656ba76 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.854981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 439/877] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:32.861625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c3af-7acf-4b66-a5ab-380cb6b43ed2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:32.862177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c3af-7acf-4b66-a5ab-380cb6b43ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:32.862177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567c3af-7acf-4b66-a5ab-380cb6b43ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:32.880293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f567c3af-7acf-4b66-a5ab-380cb6b43ed2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:32.881769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f567c3af-7acf-4b66-a5ab-380cb6b43ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:32.957435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 439/878] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:32.980992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2268dff-9178-4435-bd83-ea877656ba76 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.095938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2268dff-9178-4435-bd83-ea877656ba76 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.101482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7d20-b3c7-4f8f-aefd-28f1f631de7c None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.102054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7d20-b3c7-4f8f-aefd-28f1f631de7c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.102569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae7d20-b3c7-4f8f-aefd-28f1f631de7c None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.104457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 440/879] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:33.110320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.110892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.111375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.130043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:33.132003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:33.134610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.135414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.136414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.136414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.136621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.138000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:33.150876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:33.152011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:33.153427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 440/880] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:33.158575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.218272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 441/881] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:33.225585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:33.241713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.310652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d934cf-6c04-4e89-9bb5-010a768b88d1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.322542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:33.355876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.356572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.356851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.357119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.357950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:33.359807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.361281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.371543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 441/882] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:33.372523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.384203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66d66-e3f1-41b8-b361-68e200bc3f3b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.430160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.431289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.431573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.431848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.432924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.434314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:33.453126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:33.454689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:33.455899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 442/883] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:33.460176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.498633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2cc5-be52-48e7-ab69-c264e04fd5e0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.502311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:33.537528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.538596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.539129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.539620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.540596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:33.541111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.542719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.548594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 442/884] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:33.554474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.602873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ceb4-87c0-4520-a34b-65af5c7aa48a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.635561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:33.651184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.651868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.652157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.652443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.653495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:33.653849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.656793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.665596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 443/885] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:33.669063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.670212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4990-7d94-4774-8570-6d5572a7be0c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.707928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.708708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.709115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.709469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.710414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] RBAC: Adding query filter params (interface=public, service_id=714dace91a1142a5a76fad67879cc6ec, region_id=RegionOne) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:33.710796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.712286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.723497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 443/886] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/endpoints?service_id=714dace91a1142a5a76fad67879cc6ec&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:33.724520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:33.767968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:33.790769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc533411-f960-46e8-ad14-d65c33e7d5c9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.831831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.832556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.832846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.833122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.833877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:33.834188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.835696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ff0bb-900c-464c-af1b-2c3d6ee0615b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.846586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 444/887] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:33.862561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20168b9-1ba1-4164-a411-b7cb46545218 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:33.903093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:33.904179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:33.904674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:33.905212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:33.906185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:33.907829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d2395-a946-4ec3-9c43-090ae07b2ed8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:33.914954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 444/888] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:33 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:04:34.947927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4674-2767-4986-b8a8-621db0c7d60c None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:34.948483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4674-2767-4986-b8a8-621db0c7d60c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:34.948483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4674-2767-4986-b8a8-621db0c7d60c None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:34.950141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 445/889] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:34.955542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d82f0-4ee4-46ca-81a3-ecc225c53272 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:34.955979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d82f0-4ee4-46ca-81a3-ecc225c53272 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:34.956070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d82f0-4ee4-46ca-81a3-ecc225c53272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:34.973385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e79d82f0-4ee4-46ca-81a3-ecc225c53272 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:34.974600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e79d82f0-4ee4-46ca-81a3-ecc225c53272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:35.044332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 445/890] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:35.058735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66babf61-85d9-45bc-b4d2-1a6d625e27d8 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.059434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66babf61-85d9-45bc-b4d2-1a6d625e27d8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.059930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66babf61-85d9-45bc-b4d2-1a6d625e27d8 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.061825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 446/891] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:35.067631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d510-2ddb-4296-be0c-299695621366 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.068398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66babf61-85d9-45bc-b4d2-1a6d625e27d8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.068552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d510-2ddb-4296-be0c-299695621366 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.068552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d510-2ddb-4296-be0c-299695621366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.090735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b556d510-2ddb-4296-be0c-299695621366 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:35.091953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b556d510-2ddb-4296-be0c-299695621366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:35.116638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.139258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.179139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 446/892] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:35.197914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66babf61-85d9-45bc-b4d2-1a6d625e27d8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.203433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d510-2ddb-4296-be0c-299695621366 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.237494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.238367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.238648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.238919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.239571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.240940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:35.259805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:35.261018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:35.262135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:35.264866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 447/893] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:35.270536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.324531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d510-2ddb-4296-be0c-299695621366 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.363994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.365145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.365616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.366058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.378080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:35.380823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7b6c-203c-40dd-8215-a0beb5cc3c7d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:35.386737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:35.387893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:35.388954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:35.393052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 447/894] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:35.393993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.409990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.415083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.431330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.432858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.433427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.433923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.434987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:35.435788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.438509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.445187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 448/895] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:35.450655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.513459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14542621-a764-476a-8e08-f6ba5620c2f7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.554768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.555816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.556343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.556834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.557830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:35.558352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.559958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.574237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 448/896] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:35.575594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.583370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16d8c-8b70-49ba-a56a-bd2bf076cc13 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.627580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.628256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.628529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.628977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.629872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:35.630339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.632111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.643264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 449/897] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:35.648484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.687840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.712562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137d538-9862-44fc-ae05-ac310376af7c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.718424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.753589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.754576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.754930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.755274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.768202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.769881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.788523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cebb-c295-4beb-aed0-14f84a6e8012 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:35.788718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:35.789596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:35.790542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:35.790542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:35.790542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:35.790542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:35.794870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 449/898] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:35.796516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.834786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.835458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.835749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.836032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.836836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] RBAC: Adding query filter params (interface=public, service_id=d142338d937740f1b6e5398fac163e1b, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:35.837156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.838588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.844747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 450/899] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/endpoints?service_id=d142338d937740f1b6e5398fac163e1b&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:35.851656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.903166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1762-001f-4083-b124-54fd045dd77e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.934321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.941003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:35.941808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:35.942185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:35.942511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:35.943403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:35.943773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:35.945156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:35.963032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 450/900] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:35.964071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:35.971901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8585f-790a-45d6-a056-159f408c4ba4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:35.981778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.012452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.013471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.013994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.015027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.016111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.018086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdecf7-4058-45b2-a40e-d17d4ed8e2a9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.034008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 451/901] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:04:36.072873 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86c168-7d5c-45c7-b183-b592c7f10cde None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.078003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7291f4-1199-4047-ad87-46f934c91336 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.078303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7291f4-1199-4047-ad87-46f934c91336 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.078576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7291f4-1199-4047-ad87-46f934c91336 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.080103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 452/902] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:36.087495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a875ba-f32b-407f-be63-78a71bf53643 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.088157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a875ba-f32b-407f-be63-78a71bf53643 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.088649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a875ba-f32b-407f-be63-78a71bf53643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.108489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a6a875ba-f32b-407f-be63-78a71bf53643 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:36.109791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a6a875ba-f32b-407f-be63-78a71bf53643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:36.117217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.119173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.119716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.120250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.133034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.135909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:36.158231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:36.159256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:36.160215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:36.168134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 451/903] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:36.170903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.204074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 453/904] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:36.210296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2510-a814-4e07-a6bb-6ce0a2733f38 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.210762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2510-a814-4e07-a6bb-6ce0a2733f38 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.211255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2510-a814-4e07-a6bb-6ce0a2733f38 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.212844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 454/905] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:36.218897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.219191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.219476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.238584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:36.239812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:36.242968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.319615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc546c-ef9e-4012-ba24-53e30658acd3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.329237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 455/906] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:36.330004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.360301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.361115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.361400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.361712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.362555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:36.362864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.364430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.369842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.387155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 452/907] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:36.387155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.457811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a16e-460a-4921-9449-d77ef081e121 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.495344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4dea1-c52c-49f2-b820-05da16564463 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.496210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.497077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.497507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.497962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.498682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.500226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.505960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.533498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.534332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.534612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.534887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.535540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.536913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:36.549436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:36.558251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:36.559368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 453/908] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:36.560381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.605915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 456/909] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:36 2022] POST /identity/v3/services => generated 241 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:36.607097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.678646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17c209-b263-49ae-bce3-87c9e884a693 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.734453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.735128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.735410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.735683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.746066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.758352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8a65-5f9c-4fe0-8577-b31181d20f67 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.783673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:36.806135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.806615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.806898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.807173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:36.807889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:36.808197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.809656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.816059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 457/910] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:36.822214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.828596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:36.830303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:36.948735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137b8f0-5679-47c9-8417-134a75974535 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:36.957596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 454/911] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:36.962751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:36.996720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:36.997381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:36.997695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:36.997971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.000033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:37.000486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.001919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.012721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 458/912] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:37.013914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:37.038073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:37.046044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:37.080049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b8f9-831c-4a17-a0f8-08004072c913 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.117958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.119168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.119671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.120169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.132298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.134092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.139270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0d7a-4bf5-4174-8e5c-7850fde81403 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:37.154341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:37.155361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:37.156260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:37.156260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:37.156260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:37.156260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:37.161924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 455/913] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:37.164495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:37.186998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.188548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.188912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.189267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.190366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.191755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.277958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 459/914] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:37.278151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d836-0672-4e5f-8081-3914b52e29f8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.307562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:37.330725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.331327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.331677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.331958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.332817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:37.333128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.334620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.349463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 456/915] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:37.355437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:37.443865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:37.473200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcedb95-27ed-4797-9ce6-6029400eafe7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.509218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.510108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.510426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.510718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.518169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.519766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:37.536680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:37.537697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:37.538603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 460/916] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:37.545357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:37.655065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5951-6ced-4597-9805-9368b9228c52 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.691904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.692579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.692866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.693208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.694043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:37.694408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.695860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc574-0db9-4a98-8ffd-00986275ddc1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.709846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 457/917] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:37.715886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:37.828416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e2303-e1a7-4b99-bdf4-d5229588b041 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:37.867418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:37.868461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:37.868978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:37.869460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:37.870519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] RBAC: Adding query filter params (role.id=2a287ee8dc3446d781f7cd42f9331c4f, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=92ec739cd04543e4b75886c851ef9412) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:37.871046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:37.872695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c23c8-9256-41c6-9327-548a562456b1 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:37.879520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 461/918] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:37 2022] GET /identity/v3/role_assignments?user.id=92ec739cd04543e4b75886c851ef9412&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=2a287ee8dc3446d781f7cd42f9331c4f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:37.885639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:38.187475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dfe26-72a9-4ef4-805b-28091cee79da None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.188005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dfe26-72a9-4ef4-805b-28091cee79da None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.188005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dfe26-72a9-4ef4-805b-28091cee79da None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.189684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 458/919] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:38.195109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.195564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.195651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.213483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:38.214702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:38.284507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 462/920] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:38.308116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dfe26-72a9-4ef4-805b-28091cee79da None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:38.346369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:38.419381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dfe26-72a9-4ef4-805b-28091cee79da None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:38.454980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:38.455766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.456049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.456319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.456966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:38.458348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:38.471700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:38.472689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:38.473541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 459/921] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 21 09:04:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:38.479362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:38.591276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06025c-42b6-41dd-a537-1616307e240f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:38.621085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:38.629710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:38.630827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:38.641336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 463/922] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:38.644386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:38.759459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:38.762893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af19bb5-0597-4b44-91ba-152d660a2099 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:38.799178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:38.799830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.800116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.800387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.801100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:38.801407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:38.802811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd226f-3b73-470c-9d4c-32718e270d33 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:38.808259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 460/923] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:38.813870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:38.832817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7192-ecb3-4437-a437-2c97bfac53f9 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.833122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7192-ecb3-4437-a437-2c97bfac53f9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.833385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7192-ecb3-4437-a437-2c97bfac53f9 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.834999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 461/924] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:38.839956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.840254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.840529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.858237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:38.859445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:38.935479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848015d-18c4-41ac-bc5d-a081233f0f7f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:38.937921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 462/925] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:38.957347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:38.980828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:38.982199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:38.982731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:38.983459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:38.984834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:38.986488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.068964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:39.079268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16e981-0d92-4b43-98a8-00fc930f5072 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.122037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 464/926] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:39.128685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.129963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.130766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.131248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.132184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.133932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:39.150388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:39.158453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.159537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 463/927] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:39.160349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:39.223928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:39.286405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5544-54d1-4aee-aa41-894280201263 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.328887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.329500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.329851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.330135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.330849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:39.331181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.332564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.337971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 465/928] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:39.344241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:39.459811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc3b2-f7d4-489a-9181-e04d1b0c70ac None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.498677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.499356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.499653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.499932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.500784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:39.501104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.502515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6663a-1686-49be-bf14-7262bd3d0884 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.508465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 464/929] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:39.514934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:39.619696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d678d-817c-4d64-a481-ba234b631f62 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.620000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d678d-817c-4d64-a481-ba234b631f62 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.620190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d678d-817c-4d64-a481-ba234b631f62 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.621948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 465/930] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:39.627744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.628293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.628777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.631003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edb16a-aaeb-48f4-951f-00a25de13d19 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.645162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:39.649914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:39.651380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:39.667666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.668157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:39.668341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.668596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.668866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.669689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] RBAC: Adding query filter params (interface=public, service_id=29793a958c3d4a1b9d6419c296b3b10b, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:39.670002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.672229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.682398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 466/931] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:39 2022] GET /identity/v3/endpoints?service_id=29793a958c3d4a1b9d6419c296b3b10b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:39.683735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:39.741921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 466/932] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:39.760711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:39.796590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd347a-4486-4414-8809-a981afb22162 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.833370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.834071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.834353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.834626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.835305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.836742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.847677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 467/933] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:39 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:04:39.879825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600ce5b-5228-4830-b1ff-3b3f5c2e01c8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:39.923709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:39.924394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:39.924673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:39.924943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:39.925687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:39.927138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:39.928518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING keystone.server.flask.common [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 09:04:39.982336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.sql.core [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 09:04:39.982336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 09:04:39.982336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [parameters: {'id': 'f896224c314642ac992bb1ea86df0e90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 09:04:39.982336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80464) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8ea13cfc-5840-4bdb-ab91-fa5c572eeadf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f896224c314642ac992bb1ea86df0e90.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f896224c314642ac992bb1ea86df0e90. Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:04:39.991132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 09:04:39.992033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application yield resource Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise self.value Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application session.commit() Jul 21 09:04:39.993021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.flush() Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application compat.raise_( Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 09:04:39.993978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 09:04:39.994911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:04:39.995812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [parameters: {'id': 'f896224c314642ac992bb1ea86df0e90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:39.998445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:40.000610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f896224c314642ac992bb1ea86df0e90. Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:40.002762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 467/934] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 21 09:04:39 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:40.010499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.033148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae217-bc15-4b3f-becd-9fd9135b045a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.033463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae217-bc15-4b3f-becd-9fd9135b045a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.033842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae217-bc15-4b3f-becd-9fd9135b045a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.042524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 468/935] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:40.043517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.043774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.044063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.054511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:40.064705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:40.070479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:40.072950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:40.140151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2163cc-d78f-4512-8d6d-fd1f9917241d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.181081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 469/936] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:40.189899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.190973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.191453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.191983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.199414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:40.201284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:40.204371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:40.216386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:40.217962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:40.218865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:40.221287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 468/937] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:40.227248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.314605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2098-6f4d-4bbf-85b3-9ef6f911f819 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.335269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:40.338629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac01e0-ae56-4a07-8d83-6474d7527e3e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.354414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.354935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.355232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.357691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.367606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:40.377542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:40.377820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:40.378736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:40.379565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:40.381783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.381975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:40.382434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.382918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.383962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:40.384182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 470/938] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:40.384696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:40.385121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.386762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:40.413782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 469/939] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:40.503182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6cfd6-1be2-4cb0-b4aa-6520db86a901 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.541731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.542471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.542814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.548360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.548360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:40.548360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:40.548360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:40.556551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 471/940] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:40.563989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.671662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047c15-c15b-475d-925a-30a6b24e1118 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.706795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.707593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.707873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.708145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.719548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:40.721015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:40.740998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:40.741976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:40.742887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:40.742887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:40.742887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:40.742887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:40.742887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 470/941] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:40.749629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.809965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:40.856363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feca46c-4388-41fa-9434-80fbcb24a947 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:40.900862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:40.901540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:40.901943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:40.902220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:40.902952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:40.903264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:40.905230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:40.918560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 472/942] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:40.924977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:40.942460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.041137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1163e-3296-4d56-bf35-8a8dfa391a79 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.079122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.079968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.080252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.080532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.089081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.090577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:41.107444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:41.108525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:41.109482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 471/943] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:41.116688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.224763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3612039-daf0-46a6-88dc-5d5fdf00eda8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.249472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.262874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.263559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.263844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.264151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.267369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:41.267369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.267369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1fe85-495b-4fd1-b9c5-880920e25f17 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.285019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 473/944] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:41.294397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.380009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.400435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139f71-fb90-437d-9593-08be4aceb4e8 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.401290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139f71-fb90-437d-9593-08be4aceb4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.401809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2139f71-fb90-437d-9593-08be4aceb4e8 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.403668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 474/945] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:41.410141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.410478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.410761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.415122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a67244-bd14-4009-a6df-6969231914a8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.429425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:41.430649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:41.458859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.460538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.461047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.461809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.475609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.478036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:41.501069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:41.502058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:41.502964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:41.502964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:41.502964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:41.502964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:41.505208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 472/946] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:41.512816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.517058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 475/947] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:41.539982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.634494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000a4d-1f77-4877-96ad-2529f15930c5 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.646211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d03b9-676f-4e6f-b8ba-bd5f30eaa1d6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.648935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.662099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.674970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.675914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.676338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.676766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.677971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:41.678443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.680036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.685419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.687014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.687360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.688009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.688886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.690752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.697725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 473/948] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:41.703967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:41.709681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:41.710933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:41.711962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:41.719082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 476/949] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:41.719891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.821027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48584db8-5d3e-4121-b381-197c0ef15559 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.824920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b847506-94b4-4f1d-874f-90322d9df903 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:41.860282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.861456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:41.861937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.862366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:41.862498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.862826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:41.863117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.863279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:41.864266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:41.864673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.866305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.871274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:41.872949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:41.877317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 477/950] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:41.878309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:41.894256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:41.895513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:41.896664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:41.898934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 474/951] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:41.904554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:41.924144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:41.965977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:42.010593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98a17a-8ba1-4e41-8189-d2598f24412b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.031418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a3f5-88eb-4fb0-bbfb-4ad590905be0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.046739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.047417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.047698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.047969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.048722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:42.049031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.050462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac24228-acda-4b0d-b10b-1ccfef1e90d2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.055193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 478/952] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:42.056410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95858-34a7-40aa-8752-ceedde04edc7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.056693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95858-34a7-40aa-8752-ceedde04edc7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.056973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95858-34a7-40aa-8752-ceedde04edc7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.058674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 479/953] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:42.070218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.070512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.070792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.071949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.072618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.072912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.073191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.074031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:42.074343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.075835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.094635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:42.095872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:42.100731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 475/954] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:42.106339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.186402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 480/955] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:42.206711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.240330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:42.243788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c228c2-5e34-446c-a3e5-89a6d97acf0d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.246662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:42.288121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.289036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.289318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.289621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/92ec739cd04543e4b75886c851ef9412/roles/2a287ee8dc3446d781f7cd42f9331c4f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.292143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=92ec739cd04543e4b75886c851ef9412, role_id=2a287ee8dc3446d781f7cd42f9331c4f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.293636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.340014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c95b8-aafc-4e14-9998-25c512f2dd20 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.374802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 476/956] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:42 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/92ec739cd04543e4b75886c851ef9412/roles/2a287ee8dc3446d781f7cd42f9331c4f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:42.392868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.393747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.394091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.394368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.395105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.396760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:42.411191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:42.412770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:42.413796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 481/957] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:42.419111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.544859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f776-2e7e-42de-b33a-ae9bd7e6cfab None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.585675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.586943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.587449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.587954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.588931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:42.589443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.591127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba61c74-03de-4749-8e67-1ca56a2ada85 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.598161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 477/958] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:42.603590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.652551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c169-4ed9-4a68-8a6e-eee6b7e8bed4 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.652864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c169-4ed9-4a68-8a6e-eee6b7e8bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.653122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c169-4ed9-4a68-8a6e-eee6b7e8bed4 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.655752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 478/959] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:42.665918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.666211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.666497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.689207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:42.691644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:42.714994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:42.722061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:42.728194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376355f5-3742-4bc2-8091-d38329a29963 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.770345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 479/960] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:42.777181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.777893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.778180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.778458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.779171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:42.779481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.780956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.786628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 482/961] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:42.796302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.799085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:42.924281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d98387-addc-468c-8a94-f93ab167bbf9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.926888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac259-cc62-4038-b4b7-83556ff5d49e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:42.964291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.964962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.965247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.965526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.966316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.968510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:42.972110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:42.972793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:42.973093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:42.973344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:42.974081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:42.975503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:43.034044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.sql.core [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 09:04:43.034044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 09:04:43.034044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [parameters: {'user_id': '35a9da91b54e47f7b26e35f4e5947dca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 09:04:43.034044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80464) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:04:43.041666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:04:43.042746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application yield resource Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application next(self.gen) Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise self.value Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application session.commit() Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 09:04:43.043771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.session.flush() Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application compat.raise_( Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 09:04:43.044678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 09:04:43.047866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application conn.query(q) Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application result.read() Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 09:04:43.050231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [parameters: {'user_id': '35a9da91b54e47f7b26e35f4e5947dca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:43.052651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 09:04:43.055776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 483/962] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 21 09:04:42 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:43.058115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:43.074270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:43.086371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 480/963] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:43.194598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f4d5-37a4-44f6-a78d-aa0bfe529bad None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:43.249064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:43.250399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:43.250918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:43.251396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:43.260770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:43.262908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1dd48d26-93f3-40a3-a92c-18775ef65648 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:43.280837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:43.281968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:43.283189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 484/964] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:43.289968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:43.316768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:43.408278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0aa0-5f8b-4b04-b6e6-b3cb63ffcd0a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:43.444352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:43.445098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:43.445320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:43.445612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:43.446428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:43.446731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:43.448174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e042d-790a-414b-9594-7ab2b34eef5b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:43.486132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 481/965] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 21 09:04:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:44.239136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805ea5-ed8a-4af6-8203-416521c865d0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.239668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805ea5-ed8a-4af6-8203-416521c865d0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.239668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805ea5-ed8a-4af6-8203-416521c865d0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.241255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 485/966] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:44.246661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c710ca-ea3d-4037-9b56-4ac1a3f1daeb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.246962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c710ca-ea3d-4037-9b56-4ac1a3f1daeb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.247250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c710ca-ea3d-4037-9b56-4ac1a3f1daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.265406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-45c710ca-ea3d-4037-9b56-4ac1a3f1daeb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:44.267536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-45c710ca-ea3d-4037-9b56-4ac1a3f1daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:44.349595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 482/967] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:44.370631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805ea5-ed8a-4af6-8203-416521c865d0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:44.450890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:44.489040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805ea5-ed8a-4af6-8203-416521c865d0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:44.541527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:44.541527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.541527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.542046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.542566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:44.543945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:44.564590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941e49-b196-4526-80d1-7b69a60b1c19 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.565114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941e49-b196-4526-80d1-7b69a60b1c19 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.565114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941e49-b196-4526-80d1-7b69a60b1c19 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.566520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 483/968] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:44.571612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.571914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.572179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.578530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:44.590672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:44.591880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:44.621916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 486/969] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:44 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:44.685637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 484/970] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:44.707703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:44.828656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312768e-3519-4f35-af58-582c0eb418e0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:44.878198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:44.886395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:44.887770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.888240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.892377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.909430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:44.927067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:44.928092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:44.929087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:44.937811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 487/971] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:04:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:44.937895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.047706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda3b2-2c91-4409-badd-d7e251ffbb86 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.075551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:45.088800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.088800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.088800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.088800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.089922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:45.089922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.089922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a9dd6-8bce-4f9c-ac8c-5f89cf2ce717 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.109753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 485/972] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:04:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:45.112019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.226087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d5bd5-0143-4e49-b9c9-9c76a32b34d7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.259733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e84a-9b8b-41c1-9617-1113056ffb43 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.260016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e84a-9b8b-41c1-9617-1113056ffb43 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.260288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94e84a-9b8b-41c1-9617-1113056ffb43 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.261664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 486/973] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:45.269000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.269585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.270057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.270519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.270863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.271148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.271425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.284933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.287412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.288491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:45.289756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:45.312725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:45.313875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:45.319449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:45.319449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:45.319449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:45.319449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:45.319449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 488/974] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:45.320843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.374328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:45.381799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 487/975] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:45.406384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.442226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ddfa8-a01b-4617-b8af-fabd8bff1985 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.490470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.491750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.492313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.492888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.494794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:45.494794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.496769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.512791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 489/976] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:45.519634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.528539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e62a-da9b-4e2b-b4f8-840c854fbc29 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.556029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:45.575291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.576111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.576971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.577348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.577891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.579415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:45.593398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:45.595482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:45.597187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 488/977] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:45.600724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.653706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab285b-666c-4cff-bd64-b84e2e2c1209 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.656801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:45.696996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.698307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.698868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.699288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.707817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.709641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.714892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512442f-72d2-4ad2-a5b9-53b86d88913f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:45.725978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:45.727127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 09:04:45.728079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:45.728988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 490/978] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:45.735585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.765516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.766227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.766511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.766789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.768028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:45.768339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.769942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.775397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 489/979] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:45.781664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.852125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:45.864588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70356b-3a52-4545-b8c9-4c5d908ba93b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.905725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.906778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.907248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.907738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.908604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:45.908906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.910400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.911787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066537-56c3-4f45-b464-08fb25da16ac None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:45.937602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 491/980] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:45.943774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.950001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:45.950675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:45.950959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:45.951233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:45.952564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:45.952870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:45.954275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:45.959694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 490/981] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:45.965549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:45.971021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.062397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9197-670c-4d11-a3cf-4d811f9b7762 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.099667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b852049-41d7-463a-82ea-1db4f4d07689 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.105248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.106294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.106760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.107223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.114370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.147868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.148832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.150493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.151135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.152917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] RBAC: Adding query filter params (interface=admin, service_id=29793a958c3d4a1b9d6419c296b3b10b, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:46.153444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.156421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.162121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 491/982] 10.222.0.67 () {56 vars in 1249 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/endpoints?service_id=29793a958c3d4a1b9d6419c296b3b10b&interface=admin®ion_id=RegionOne => generated 193 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:46.169363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.193603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.195575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.221713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.288697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d2cb0-5dc4-4d16-a343-ad1be9027d88 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.314660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 492/983] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:45 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:04:46.315798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.332052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.332725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.333012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.333288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.334004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.335398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.342775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 492/984] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:04:46.454723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4632791-da02-4888-8da8-6d381cb4bf49 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.479941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.493632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.494451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.494826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.495048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.507111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.508554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:46.527307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:46.528282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:46.529593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:46.529593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:46.529593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:46.529593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:46.529593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 493/985] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:46.534773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.583209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.644345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7feca3-4528-43a0-b418-2e83de323b97 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.678717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.679384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.679665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.679937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.680648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:46.680951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.682347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b802c-5796-48d5-b567-a9ca04efdbcd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.695668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 493/986] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:46.701026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.785146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852e43c-5716-4093-bada-87933cb33484 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.785448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852e43c-5716-4093-bada-87933cb33484 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.785684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852e43c-5716-4093-bada-87933cb33484 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.787144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 494/987] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:46.791875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.792166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.792446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.807604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c177ce-83a9-442a-a299-4ce924e23fca None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:46.808861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:46.810107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:46.846290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:46.847086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:46.847374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:46.847642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:46.854479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:46.855913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:46.871313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:46.872443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:46.874217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:46.877809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 494/988] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:46.878672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.886167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 495/989] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:46.909536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:46.915210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.946202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:46.987870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2469-6f2e-4132-9460-31c99a7c0ae2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.020430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc57f9-72d0-44ac-9d42-8a0f89b820d2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.028074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.028733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.029011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.029283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.030724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:47.031109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.032541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.045536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 495/990] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:47.051985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:47.059583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.060391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.060733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.061020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.061722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.063110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:47.075450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:47.077430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:47.078573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 496/991] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:47.083061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:47.157987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:47.168577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753670c-bd9b-4424-8443-5772e600eb50 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.185449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:47.193811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78726ef-162e-42eb-8cb5-3da6d9a6125c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.207947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.208624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.208903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.209183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.210049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] RBAC: Adding query filter params (role.id=2a287ee8dc3446d781f7cd42f9331c4f, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=92ec739cd04543e4b75886c851ef9412) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:47.210364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.211795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.219436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 496/992] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:47 2022] GET /identity/v3/role_assignments?user.id=92ec739cd04543e4b75886c851ef9412&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=2a287ee8dc3446d781f7cd42f9331c4f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:47.245847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.246549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.246838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.247117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.247845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:47.248227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.250416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.256649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 497/993] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:47.262257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:47.380960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8474-dac4-45d4-805c-31a3a08e89c8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.418986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.420613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.421055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.421344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.422324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:47.422437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.423753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.429106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 497/994] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:47.435029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:47.547705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6aee-4e00-470a-9d07-61ce1757a48d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.584321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.584959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.585243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.585520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.586351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] RBAC: Adding query filter params (interface=public, service_id=90808490d42c4be3a267529ad030b646, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:47.586670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.588156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df3569-6d23-4c08-98bc-b9b256dbeb27 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.598603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 498/995] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:47 2022] GET /identity/v3/endpoints?service_id=90808490d42c4be3a267529ad030b646&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:47.599571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:47.625097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:47.704006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aea798-00ce-48dd-8944-504fbcc2d649 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:47.740035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:47.740711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:47.740997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:47.741275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:47.741993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:47.743397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f65b2-1b4e-4b2d-9e93-44f7152fd4f2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:47.749906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 498/996] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:47 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:04:48.434257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72520-4ec7-4fbe-9a62-b82c3842ef82 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:48.434626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72520-4ec7-4fbe-9a62-b82c3842ef82 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:48.434829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b72520-4ec7-4fbe-9a62-b82c3842ef82 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:48.436413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 499/997] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:48.441955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:48.442417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:48.442592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:48.459988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:48.461515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:48.535394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 499/998] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:48.558517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b72520-4ec7-4fbe-9a62-b82c3842ef82 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:48.583419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:48.665397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b72520-4ec7-4fbe-9a62-b82c3842ef82 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:48.703358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:48.704405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:48.704830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:48.705242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:48.706067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:48.707760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:48.720252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:48.721407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 09:04:48.722376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:48.724091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 500/999] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 21 09:04:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:48.728994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:48.747822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:48.837216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5205b-407f-4ce1-a708-e3e7ed246f2e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:48.872245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:48.872967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:48.873831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:48.874078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:48.874828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:48.875138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:48.876569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:48.887014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 500/1000] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:48.888660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:48.977875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:48.994370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb2be-2b0b-4283-92a1-5e89a6d54e1b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:49.031117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:49.031883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.032106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.032358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.033080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:49.033394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:49.034823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af52a6-f7ff-4059-be1e-7a65e09373e2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:49.044474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 501/1001] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 21 09:04:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:49.046857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:49.138406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:49.158291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9d48-afc1-47ea-baa2-0ca78d4877fd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:49.193104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:49.193794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.194082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.194358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.195108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:49.196481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc0af-d464-4173-8916-cc2e4df84dd6 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:49.269080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 501/1002] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:04:49.363856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631381b-e49d-4c2a-ae4c-55b6abeaa3c5 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.364213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631381b-e49d-4c2a-ae4c-55b6abeaa3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.364451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631381b-e49d-4c2a-ae4c-55b6abeaa3c5 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.366024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 502/1003] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:49.371433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.371712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.371988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.390826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:49.392139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:49.477815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 502/1004] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:49.500312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631381b-e49d-4c2a-ae4c-55b6abeaa3c5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:49.610944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631381b-e49d-4c2a-ae4c-55b6abeaa3c5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:49.653211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:49.653980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.654322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.654600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] PATH_INFO: `/v3/services/image` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.655253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:49.656623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:49.668818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:49.670684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:49.671628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 503/1005] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 21 09:04:49 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:49.678437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:49.744605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:49.780775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580c94c-f856-4c8e-b42b-35bc6fa6c5b6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:49.817013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:49.818074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.818598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.819095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.819992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] RBAC: Adding query filter params (name=image) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:49.820491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:49.822092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761e2d-a145-4792-9218-ad38ae420898 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:49.827794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 503/1006] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:49.833687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:49.840293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964025b-b705-4e1c-addc-f1b31cd0da71 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.840585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964025b-b705-4e1c-addc-f1b31cd0da71 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.840865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964025b-b705-4e1c-addc-f1b31cd0da71 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.842955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 504/1007] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:49.847869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.848161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.848442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.852078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:49.866561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:49.867778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:49.942606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 505/1008] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:49.949370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474a759-e323-4940-b393-0f098814fa21 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:49.965432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:49.988733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:49.989998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:49.990546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:49.991091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:49.992242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:49.992765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:49.995012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:50.000422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 504/1009] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:50.039759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:50.086417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58a30-1c80-4f4b-89b3-1a6a165f5884 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:50.124700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:50.125531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:50.125857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:50.126146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:50.126833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:50.128237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:50.141807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:50.148319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:50.149180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 506/1010] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:50.149989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:50.234064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:50.256866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efa164-0ffe-43fb-aaaf-cbb757882ea2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:50.291259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:50.291936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:50.292221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:50.292504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:50.293220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:50.293528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:50.295470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:50.313930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 505/1011] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:50.315617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:50.418935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e02e7-ec63-48b9-a859-420387178ae5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:50.442719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:50.454495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:50.470861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883afcfa-40d9-4aa2-9d2b-e30a8c06e2c3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:50.471354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 507/1012] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 21 09:04:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:50.471433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:50.578463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73b2a-8d6c-4874-9f19-4d50c1457ce4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:50.614053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:50.614712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:50.614998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:50.615275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:50.616015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:50.617378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae0e3-413d-4c7b-bd4f-5cfbf276c288 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:50.717871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:50.724408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 506/1013] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:51.410580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697b1d-d7fa-4963-b53b-29125273e4ff None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:51.411095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697b1d-d7fa-4963-b53b-29125273e4ff None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:51.411173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697b1d-d7fa-4963-b53b-29125273e4ff None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:51.412684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 508/1014] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:51.417804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:51.418159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:51.418505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:51.435135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:51.437176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:51.515322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 507/1015] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:51.538924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e697b1d-d7fa-4963-b53b-29125273e4ff None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:51.674666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e697b1d-d7fa-4963-b53b-29125273e4ff None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:51.708712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:51.709508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:51.709815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:51.710088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:51.711245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:51.712670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3746be-c55e-4396-8208-8fbe254e617a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:51.714466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 509/1016] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:51.720589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:51.821833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4fedd-32d0-4693-a303-276dbf5307da None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:51.846560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:51.857916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:51.860152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:51.860152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:51.860152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:51.860152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:51.861642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c67335-f7b1-4a78-b0e9-607813bb2a17 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:51.945675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 508/1017] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:51 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:52.071376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf857-9208-4e10-b6b0-b653b323b15b None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.071673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf857-9208-4e10-b6b0-b653b323b15b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.072002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf857-9208-4e10-b6b0-b653b323b15b None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.073651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 510/1018] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:52.079082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dc8b-a4e2-4590-a308-a0943e9613d4 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.079365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dc8b-a4e2-4590-a308-a0943e9613d4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.079644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dc8b-a4e2-4590-a308-a0943e9613d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.098591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1436dc8b-a4e2-4590-a308-a0943e9613d4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:52.100261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1436dc8b-a4e2-4590-a308-a0943e9613d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:52.172934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 509/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:52.194976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf857-9208-4e10-b6b0-b653b323b15b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:52.255962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:52.312020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf857-9208-4e10-b6b0-b653b323b15b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:52.348666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:52.349333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.349638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.349915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.350660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:52.352246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11df25-520f-4620-91b5-d3d53cb22e8f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:52.431408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 511/1020] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:04:52 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:04:52.893978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439e2b-d7b0-4696-9d82-3649fd714762 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.894538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439e2b-d7b0-4696-9d82-3649fd714762 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.894538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439e2b-d7b0-4696-9d82-3649fd714762 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.895983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 510/1021] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:52.901073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.901362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.901684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.918410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:52.919629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:52.996288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 512/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:53.021101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439e2b-d7b0-4696-9d82-3649fd714762 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:53.140276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439e2b-d7b0-4696-9d82-3649fd714762 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:53.153454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:53.185107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:53.185991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:53.186277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:53.186614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:53.198928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:53.209066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:53.210522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:53.212158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 511/1023] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:53.217834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:53.274005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:53.341428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141a5b1-f77b-480d-afcd-1a7f4ce3aaaa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:53.380238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:53.380924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:53.381208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:53.381489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:53.382348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:53.382663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:53.384039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:53.398583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 513/1024] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:53.400086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:53.513930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aee672-8f0f-4a04-a8c3-b47bc8af2065 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:53.562726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:53.563072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:53.563343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:53.563632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:53.576319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:53.577854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:53.597967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:53.608433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:53.609376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:53.609376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:53.609376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:53.609376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:53.609376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 512/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:53.609683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:53.726836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284d340-6ab5-4d47-9159-699d679b4d70 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:53.729301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:53.767799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:53.768385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:53.768670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:53.768949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:53.769704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:53.770016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:53.771427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:53.788421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 514/1026] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:53.789705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:53.811140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:53.898116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0dc22-2086-4a9c-9f9c-ceae50cf29e5 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:53.932200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:53.932996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:53.933280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:53.933553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:53.941548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:53.943014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-bdf16be3-9de3-41a2-8353-1dbbae051e47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:53.957999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:53.959000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:53.964618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 513/1027] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:53.965228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.066685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34299-0c66-4271-b163-bcecf1e83d48 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.103071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.103748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.104034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.104312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.105158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:54.105526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.107144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.108873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cc41-e840-464e-9b0a-b3252b2a6362 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.109169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cc41-e840-464e-9b0a-b3252b2a6362 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.109451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cc41-e840-464e-9b0a-b3252b2a6362 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.111001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 514/1028] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:04:54.116024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.116309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.116582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.131887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 515/1029] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:54.133293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.134618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:54.135804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:54.162431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.207867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 515/1030] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:54.232272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.241344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6143b-f1e3-4a23-973b-2a7751859c77 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.242154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.281110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.282352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.282701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.282974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.333845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c631-87e3-4b7f-95c1-d5e474f72f36 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.368494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.369528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.369992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.370387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.370672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.370949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.372157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.374564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.376423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 516/1031] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:54.382057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.397810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.468810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.482727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 516/1032] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 09:04:54.489043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.492887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4a89-072f-4985-92ff-11952cfefa69 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.530345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.531019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.531307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.531588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.532305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.533842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953c86d-7869-40ea-b0cc-a4ff4b9689cf None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.593010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563356b0-9609-4ec4-8628-63b029675923 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.614677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.626570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.627360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.627645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.627923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.636162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 517/1033] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:04:54 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:04:54.637614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5733-5b0c-486c-ba08-81564c3a275e None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.637958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5733-5b0c-486c-ba08-81564c3a275e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.638731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5733-5b0c-486c-ba08-81564c3a275e None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.639483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.640668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 518/1034] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:54.640968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.646613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.646903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.647184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:54.660921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:54.662238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:54.663184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:54.663184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:54.663184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:54.663184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:54.663184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 517/1035] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:54.668122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.675569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:54.676801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:54.761602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 519/1036] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:54.791196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.800239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061799b-0623-4416-818e-a5125bb2c3cd None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.843162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.843753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.844042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.844321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.845609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:54.845609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.846781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.863106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 518/1037] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:54.867249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.869266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:54.907795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:54.912785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188ebc-005d-466a-aaeb-e026c941f9cd None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.952084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:54.952888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:54.953173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:54.953450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] PATH_INFO: `/v3/services/image` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:54.954143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:54.955604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:54.970501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:54.971559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:54.977502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 520/1038] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:54.978382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705831-8822-4d8e-ba36-ef570f20f5b4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:54.980060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.014403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.015280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.015560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.015831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.023018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.024451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:55.038918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:55.039858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:55.040760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 519/1039] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:55.046416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.097894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3938a1-a220-449d-a92f-0c7b219d4855 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.125382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:55.135096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.135768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.137897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.137897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.137897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:55.137897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.139667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.144563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 521/1040] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:55.150218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.161873 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:55.169129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18054c3-226c-4a30-a697-0204585fed03 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.207607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.208273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.208558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.209181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.209641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:55.209954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.211383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.229333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 520/1041] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:55.231201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.270649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1e50-4bb5-43c7-b347-b9ffdb5473ea None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.315365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.316052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.316327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.316610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.317332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] RBAC: Adding query filter params (type=image) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:55.317688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.319072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.329044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 522/1042] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:55.330253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.355722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82324-8e41-43c0-82bc-57393e9d9475 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.393089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:55.393670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.394339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.394624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.394898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.395732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] RBAC: Adding query filter params (role.id=2a287ee8dc3446d781f7cd42f9331c4f, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:55.396050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.397493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.405106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 521/1043] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:55 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=2a287ee8dc3446d781f7cd42f9331c4f => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:55.452013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef501-b174-4177-ab40-aad787ea3c86 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.493241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.493982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.494250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.494533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.495357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] RBAC: Adding query filter params (interface=public, service_id=d8a399341854461f88d05e67ff29afb4, region_id=RegionOne) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:55.501022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.501022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7b421-9cc5-4847-8def-148306abf4d3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.509662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 523/1044] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:04:55 2022] GET /identity/v3/endpoints?service_id=d8a399341854461f88d05e67ff29afb4&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:55.515898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:55.543649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:55.633079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725fdad-f29e-44a8-9b10-26b0949d0d99 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:55.670818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:55.671841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:55.672344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:55.672818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:55.673737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:55.675306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24787305-f8f0-4376-8511-822a71081b8a None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:55.682592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 522/1045] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:04:55 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:04:56.824169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b4ad-cd29-4a09-ae7d-dfc6f37cc62f None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:56.824706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b4ad-cd29-4a09-ae7d-dfc6f37cc62f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:56.824706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b4ad-cd29-4a09-ae7d-dfc6f37cc62f None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:56.826628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 524/1046] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:56.832333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:56.832753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:56.832939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:56.850675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:56.851886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:56.923654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 523/1047] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:56.946634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b4ad-cd29-4a09-ae7d-dfc6f37cc62f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.060823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b4ad-cd29-4a09-ae7d-dfc6f37cc62f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.079079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.096713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.097509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.097815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.098087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.109127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:57.117225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:57.118506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:57.120069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 525/1048] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:57.125431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.140049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.230945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7d963-2a37-4fa5-bffb-0282c3145e64 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.271310 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.272030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.272313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.272584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.273322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:57.273650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:57.275026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea609f-aabf-4c2c-a0c6-0d076a8b611e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:57.284109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 524/1049] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:57.289686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.396096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fe988-7b56-4961-8864-69b3bf64810b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.436690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.437887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.438175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.438455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] PATH_INFO: `/v3/users/26f39867f2e742bd9ea8ed50290e0101` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.452967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] RBAC: Authorizing `identity:get_user(user_id=26f39867f2e742bd9ea8ed50290e0101)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:57.454481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:57.456369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 526/1050] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/users/26f39867f2e742bd9ea8ed50290e0101 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:57.461662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.461928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af6e3-1f0b-46e1-8878-efae74d7e1db None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.462219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af6e3-1f0b-46e1-8878-efae74d7e1db None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.462496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af6e3-1f0b-46e1-8878-efae74d7e1db None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.464104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 525/1051] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:57.470148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.470433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.470711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.489499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:57.491171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:57.508006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.569648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 526/1052] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:04:57.581928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a204-e384-4127-8047-e28f71cdfba5 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.592918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.596160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.619381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.620037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.620326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.620605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.702854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:57.704219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b761ed-1269-4927-accd-c3fada8cf9e6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:57.711542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1c534-620b-46d2-8c26-9b66d41e9b7a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.747424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.748930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.749779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.750068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.750342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.761548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:04:57.770422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:57.771428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:57.772833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 527/1053] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:57.778020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.820989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 527/1054] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 09:04:57.820989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726d23-f430-4da9-acda-f6d0fc40e554 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.820989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726d23-f430-4da9-acda-f6d0fc40e554 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.820989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726d23-f430-4da9-acda-f6d0fc40e554 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.820989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 528/1055] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:04:57.827855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726d23-f430-4da9-acda-f6d0fc40e554 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.846186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:57.884165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2409a9-d92e-4fe2-928e-22c210ccc75b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.919152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.920212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.920495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.920778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.921527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:57.921871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:57.923258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e6d99-2309-4c1d-9846-1a26068e052b None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:57.931640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 528/1056] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:57.932575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726d23-f430-4da9-acda-f6d0fc40e554 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:57.932906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.933197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.933475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.953072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:04:57.954226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:57.972053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:57.972916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:57.973198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:57.973472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:57.974942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:57.976606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:57.978401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 529/1057] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:57.979178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:57.983203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.037711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 529/1058] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:04:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:04:58.038567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.088495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4bdc-28dd-4bc2-84bf-200b6f8bb7b9 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.101398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.121698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.123071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.123351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.123724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.135358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.136828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.146039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8143-d63d-4014-8d0c-85c051b0e728 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:58.154725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:58.155651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:58.156555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:58.156555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:58.156555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:58.156555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:58.156555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 530/1059] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:58.156961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.185458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.186284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.186567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.186838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.187670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=38fc5a2205324132b18aa3ed1e917577, user.id=26f39867f2e742bd9ea8ed50290e0101) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:58.187978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.189404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.195029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 530/1060] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/role_assignments?user.id=26f39867f2e742bd9ea8ed50290e0101&scope.project.id=38fc5a2205324132b18aa3ed1e917577&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:58.195812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.215539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.267248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fdd9-74db-4733-8bc8-22afbc4093aa None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.326417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.327463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.327850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.328114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] PATH_INFO: `/v3/services/image` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.328793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.330266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.340590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9b592-0b17-4e70-bdf5-8ae95653dc49 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:58.344610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:58.345775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 09:04:58.347183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:04:58.350981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 531/1061] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:58.351974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.371922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.391354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.392167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.392452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.392727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.393455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:58.393819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.395201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.409788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 531/1062] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:58.415782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.474577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510cba-7d1a-4229-b754-2830f871cc6b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.498124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.516019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.521167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.521489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.521758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.522859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] RBAC: Adding query filter params (name=image) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:58.528572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.528572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.530754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 532/1063] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:58.538417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.546067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36797d6-d912-4a79-a0f0-69b032296b66 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.586567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.587369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.587652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.587929 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.596761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.598245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:04:58.625354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:58.626418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:04:58.627380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:58.632581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 532/1064] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:58.633444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.665483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7898c-6ab6-4bd3-ae4a-e4fe8647c16c None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.681028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.709330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.710247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.710693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.710976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.711853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:58.712168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.713585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.718949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 533/1065] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:58.724788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.761866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e60385-b8e1-40b7-ad29-2ef19b805adb None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.795977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.809491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.810704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.810989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.811276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.812123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:58.812437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.814019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.837810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 533/1066] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:04:58.843734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:58.857585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1c77-518b-4782-ace7-fbfa958993d4 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.894471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:58.895148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:58.895436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:58.895717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:58.896463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:58.897875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:58.962343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:58.969662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77f9d6-4165-4d12-94a6-888b912f43f2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:58.973240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 534/1067] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:04:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:04:59.021643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:59.023238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:59.023518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:59.023791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:59.039222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:59.040693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:04:59.061427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:59.062853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:59.063757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:04:59.063757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:04:59.063757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:04:59.063757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:59.063757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 534/1068] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:04:59.069261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:59.183944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199f96-d6fc-48ec-a918-2d9a00a4cbac None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:59.186447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:59.219811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:59.220495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:59.220778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:59.221061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:59.221820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:59.222137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:59.223524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:59.236852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 535/1069] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:59.242669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:59.393011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a52d-0b74-4264-ad13-3c8d40ca88ec None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:59.430702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:59.431494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:59.431834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:59.432305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:59.439763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:59.441207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:04:59.458900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:04:59.459824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:04:59.461304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 535/1070] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:04:59.469151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:59.591817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc6362-f063-4431-a6e1-89a787d27575 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:59.626653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:59.627310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:59.627592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:59.627871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:59.628663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:04:59.628963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:59.630667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bad673-00f6-4dda-a631-27c18a4fb9b4 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:59.648197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 536/1071] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:04:59.649495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:59.661535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:59.764397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b9e8e-55bf-4fda-9f79-a9492069eac8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:59.801407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:59.802597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:59.803026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:59.803440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/2a287ee8dc3446d781f7cd42f9331c4f` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:59.805793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=923ba7b9f0414b6e8d9a3ad4cb256ebf, role_id=2a287ee8dc3446d781f7cd42f9331c4f)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:59.807366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a65dea-6257-45e5-a45d-5d0b1ccd12cd None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:59.878059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 536/1072] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:04:59 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/923ba7b9f0414b6e8d9a3ad4cb256ebf/roles/2a287ee8dc3446d781f7cd42f9331c4f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:00.279092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37699dc-c25f-4984-b4e6-fd79daa39f04 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:00.279594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37699dc-c25f-4984-b4e6-fd79daa39f04 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:00.279672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37699dc-c25f-4984-b4e6-fd79daa39f04 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:00.281198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 537/1073] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:05:00.286348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:00.286794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:00.286973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:00.311061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:00.312524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:00.381017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:00.389670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 537/1074] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:00.412049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37699dc-c25f-4984-b4e6-fd79daa39f04 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:00.440008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:00.520188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37699dc-c25f-4984-b4e6-fd79daa39f04 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:00.562275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:00.563076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:00.563359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:00.563634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:00.580253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:00.588045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:00.588966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:00.590192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:00.599979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 538/1075] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:00.600198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:00.709248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e5fa-efef-48cc-9e88-41b65205a6c3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:00.744793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:00.745459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:00.745772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:00.746050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:00.746821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:00.747127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:00.748876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:00.762573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 538/1076] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:00.767390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:00.857383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:00.877546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f50c-249b-4a1e-8980-92ec4177f213 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:00.912371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:00.913232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:00.913514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:00.913814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] PATH_INFO: `/v3/users/26f39867f2e742bd9ea8ed50290e0101` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:00.915002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] RBAC: Authorizing `identity:get_user(user_id=26f39867f2e742bd9ea8ed50290e0101)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:00.916440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:00.918236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 539/1077] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:00 2022] GET /identity/v3/users/26f39867f2e742bd9ea8ed50290e0101 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:00.924470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:00.986911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:01.033049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690560-489b-493d-8f30-6fdc72d2ee20 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:01.073139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:01.074032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.074309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.074580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.076028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:01.077631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a5005-4f6c-49f2-ae8a-1a04a953cd3f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:01.080111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 539/1078] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:00 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:01.085645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:01.115522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25d5a-d537-45f6-b3e9-ae973d557252 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.115740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25d5a-d537-45f6-b3e9-ae973d557252 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.116015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25d5a-d537-45f6-b3e9-ae973d557252 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.117384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 540/1079] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:05:01.122944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.123228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.123537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.141968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:01.143154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:01.205845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585013a-b0aa-4dfa-816f-45da328bd955 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:01.216151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 541/1080] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:05:01.239131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:01.256543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:01.257439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.257751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.258030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577/users/26f39867f2e742bd9ea8ed50290e0101/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.260350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=38fc5a2205324132b18aa3ed1e917577, user_id=26f39867f2e742bd9ea8ed50290e0101, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:01.261820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:01.300572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:01.351101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 540/1081] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:05:01 2022] PUT /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577/users/26f39867f2e742bd9ea8ed50290e0101/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:01.353959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe77e-edaf-4907-820b-92664809c09e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:01.396720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:01.397317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.397632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.397914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.485411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:01.486959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:01.553918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:01.602200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 542/1082] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 09:05:01.609064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:01.625964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:01.719532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2ef9d-b929-44ba-8244-d04b7af85e25 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:01.756499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:01.758102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.758388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.758670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.769436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:01.771103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-5379e52f-23cd-438d-bdcf-b59ad81d2812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:05:01.788555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:01.789505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:01.790481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:05:01.790481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:05:01.790481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:01.790481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:01.793653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 541/1083] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:01.796083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:01.904322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565595-b428-422e-8c3c-8bb1fbed89a4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:01.941837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:01.942508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.942794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.943105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.943921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:01.944231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:01.945610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a36f1-6941-47e9-9d74-a5ec5fd8c799 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:01.966550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 543/1084] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:01.974707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b259c-d342-47f8-af6c-7451a0e18576 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.974998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b259c-d342-47f8-af6c-7451a0e18576 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.975181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b259c-d342-47f8-af6c-7451a0e18576 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:01.976799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 542/1085] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:01.983325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:01.983683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:01.983968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:02.003113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:02.005402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:02.019744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:02.102949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 544/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:02.127364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b259c-d342-47f8-af6c-7451a0e18576 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:02.212773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:02.273248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b259c-d342-47f8-af6c-7451a0e18576 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:02.306883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:02.307700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:02.307977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:02.308244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:02.318857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:02.327564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:02.328845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:02.329746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 543/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 21 09:05:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:05:02.335498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:02.442014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0939b-ddff-42ea-b2ac-22781e712094 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:02.488085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:02.488792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:02.489102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:02.489370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:02.490189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:02.490498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:02.491918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:02.502478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 545/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:05:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:02.512554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:02.619387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d53e-cd44-44c9-be30-5476f6fd43a6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:02.643918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:02.654905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:02.656858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:02.656858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:02.656858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:02.667305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:02.668764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:05:02.687262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:02.688362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:02.689286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:05:02.689286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:05:02.689286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:02.689286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:02.689286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 544/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:02.694395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:02.706938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:02.810403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ffddc-ed96-4036-bd35-587a59c37b93 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:02.843509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:02.844179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:02.844460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:02.844737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:02.845463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:02.845801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:02.847176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:02.859509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 546/1090] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:02.865292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:02.964990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc647-3527-463f-8cf1-9e60786b505f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:02.998755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:02.999561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:02.999851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.000146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.008012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.009471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:05:03.023279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:03.024959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:03.026357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 545/1091] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 21 09:05:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:03.030307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.099188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.134094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877e71-e9ac-4213-948a-c35f20c51f39 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.169912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.170581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.170867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.171148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.171985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:03.172290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.173741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe96a-6a1c-4341-b8f4-77abd6e8ed7c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.191635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 547/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:03.197332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.233824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.300591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42575ab-9c82-46f2-add1-cd2205f3cb1f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.337205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.337888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.338172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.338449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.412278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.413758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.447044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.454587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6906-0ab5-4439-a645-a382cb00820f None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.459680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6906-0ab5-4439-a645-a382cb00820f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.459680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6906-0ab5-4439-a645-a382cb00820f None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.459680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 548/1093] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:05:03.461927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.462216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.462495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.480040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:03.481237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:03.525114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 546/1094] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 09:05:03.526967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.552963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 549/1095] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:05:03.577498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.634698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509101b1-fed8-49eb-820b-649d2c3eb31b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.639205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.670952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.672158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.672670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.672958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.675810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.684144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.685465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d049c4-ee75-45e1-a6a3-061b485ced71 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.688278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:05:03.705184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:03.706348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:03.707581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:05:03.707581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:05:03.707581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:05:03.707581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:03.707581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 547/1096] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:05:03.712737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.727654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.728456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.728738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.729014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.739641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:03.747295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:03.754014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:05:03.755121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 550/1097] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:05:03.755853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.814954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561534-3d9c-4076-b5d0-2350078d34d5 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.848913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.849628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.849874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.850149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.850887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:03.851176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.852563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.859445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e60c-3c6b-46c6-b6c3-68c0708ca1ce None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:03.865495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 548/1098] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:05:03.871123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.879815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.897779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:03.898452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:03.898735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:03.899009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:03.899805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:03.900136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:03.901510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:03.913715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 551/1099] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:03.917593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:03.922473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.976946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bd6c5-8cc4-49c4-9485-f60eafd33762 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.013936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.014739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.015023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.015295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.021191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c8e0-be64-4b81-ae16-b2bdfe8e0f49 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.022631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.024141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:05:04.038606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:04.039664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:04.040565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 549/1100] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:05:04.045931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:04.060433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.061308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.061631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.061914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] PATH_INFO: `/v3/users/26f39867f2e742bd9ea8ed50290e0101` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.063132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=26f39867f2e742bd9ea8ed50290e0101)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.064564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.066296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 552/1101] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:03 2022] GET /identity/v3/users/26f39867f2e742bd9ea8ed50290e0101 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:05:04.071861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:04.121034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:04.150379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a70a6-a9b0-435d-a42d-d6425331f894 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.160226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:04.179615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f640a-5dd9-47c5-9f0c-31c4369c8ee4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.185818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.186589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.186874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.187153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.187950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:04.188261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.189726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.202794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 550/1102] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:05:04.208973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:04.234057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.234731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.235019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.235284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.305181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.306739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.314707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff83d-8612-4528-872e-9634e3e4496a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.352397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.352972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.353258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.353525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.354383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] RBAC: Adding query filter params (role.id=2a287ee8dc3446d781f7cd42f9331c4f, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:04.354692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.354843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:04.356124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.362091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 551/1103] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:04 2022] GET /identity/v3/role_assignments?user.id=923ba7b9f0414b6e8d9a3ad4cb256ebf&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=2a287ee8dc3446d781f7cd42f9331c4f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:05:04.417496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 553/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:04.423635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:04.457717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:04.534357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72eb8db-304d-4938-bfb5-5881f9870e17 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.571950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.572822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.573103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.573382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.574701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.577018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba896a-66f5-4291-ac3f-71415d475f95 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.578934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 552/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:04 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:04.585457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:04.698211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be782-c47d-4e33-a91d-4ae327c6dde1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:04.737532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:04.737908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:04.738079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:04.738359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:04.739187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=38fc5a2205324132b18aa3ed1e917577, user.id=26f39867f2e742bd9ea8ed50290e0101) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:04.739516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:04.740957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ee29-47c0-4523-8a04-7b612e18257d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:04.747705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 554/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:04 2022] GET /identity/v3/role_assignments?user.id=26f39867f2e742bd9ea8ed50290e0101&scope.project.id=38fc5a2205324132b18aa3ed1e917577&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:06.841048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876693f-225a-42f9-9e19-6b3c99cfbeb7 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:06.841632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876693f-225a-42f9-9e19-6b3c99cfbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:06.841754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876693f-225a-42f9-9e19-6b3c99cfbeb7 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:06.843680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 553/1107] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:06.848772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:06.849219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:06.849313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:06.865881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:06.867074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:06.869905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:06.932833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 555/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:06.957924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876693f-225a-42f9-9e19-6b3c99cfbeb7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:07.061246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:07.065310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876693f-225a-42f9-9e19-6b3c99cfbeb7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:07.100016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:07.100961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:07.101312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:07.101990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:07.103218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:07.104693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6b0a9-0480-4bfe-8465-f85f57a21daf None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:07.106358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 554/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:07.112104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:07.211212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb024a-5732-4ff4-b84d-955b75f088c6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:07.245181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:07.245881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:07.246165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:07.246443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:07.248026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:07.249455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db6bd3-55f0-4d37-bd3e-531419ce4a37 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:07.261621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:07.345195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 556/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:05:07 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:05:09.448249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6557-ff86-4a28-858f-94fd4438eeb4 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:09.448809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6557-ff86-4a28-858f-94fd4438eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:09.448809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6557-ff86-4a28-858f-94fd4438eeb4 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:09.450231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 555/1111] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:09.455381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:09.455768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:09.455937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:09.472808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:09.474014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:09.540348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 557/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:09.563997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f6557-ff86-4a28-858f-94fd4438eeb4 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:09.664260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f6557-ff86-4a28-858f-94fd4438eeb4 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:09.697868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:09.698725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:09.699007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:09.699284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] PATH_INFO: `/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:09.701438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] RBAC: Authorizing `identity:get_role(role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:09.703265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:09.704653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 556/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:09 2022] GET /identity/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:09.710464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:09.813624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592652f0-7083-4e2c-a532-ee8a58da7cdf None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:09.839534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:09.848172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:09.849046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:09.849327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:09.854127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] PATH_INFO: `/v3/users/bc052848f48542bda228c2bd6d0b37ed` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:09.864004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] RBAC: Authorizing `identity:get_user(user_id=bc052848f48542bda228c2bd6d0b37ed)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:09.865608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:09.867306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 558/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:09 2022] GET /identity/v3/users/bc052848f48542bda228c2bd6d0b37ed => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:09.873728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:09.909780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:09.980980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb72b-62e5-469d-a311-3bdcb13084e8 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:10.016303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:10.016952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:10.017239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:10.017517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:10.086795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:10.088265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:10.124804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:10.193314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 557/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:10.199635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:10.307805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bccfb-02b4-4890-b34b-b53d12123810 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:10.350598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:10.351466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:10.351753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:10.352032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:10.353226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:10.355447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81610-6622-43a9-8383-d33acd468c57 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:10.357269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 559/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:10 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:10.364245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:10.470416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d07-6308-456a-8bfe-7e1a7e02de25 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:10.505448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:10.506149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:10.506432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:10.506709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:10.507765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=38fc5a2205324132b18aa3ed1e917577, user.id=bc052848f48542bda228c2bd6d0b37ed) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:10.507948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:10.509394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242e32-cb67-4964-8f2e-41776e3cdc29 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:10.513107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:10.516125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 558/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:10 2022] GET /identity/v3/role_assignments?user.id=bc052848f48542bda228c2bd6d0b37ed&scope.project.id=38fc5a2205324132b18aa3ed1e917577&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:12.571095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee7a6-5649-4d88-bf86-079c9fb2cdca None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:12.571608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee7a6-5649-4d88-bf86-079c9fb2cdca None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:12.571608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee7a6-5649-4d88-bf86-079c9fb2cdca None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:12.573021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 560/1118] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:12.578833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:12.579299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:12.579394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:12.596390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:12.597602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:12.663524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 559/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:12.685784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee7a6-5649-4d88-bf86-079c9fb2cdca None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:12.740174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:12.786133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee7a6-5649-4d88-bf86-079c9fb2cdca None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:12.820311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:12.821220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:12.821446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:12.821751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] PATH_INFO: `/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:12.823254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] RBAC: Authorizing `identity:get_role(role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:12.825094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:12.826719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 561/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:12 2022] GET /identity/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:12.832587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:12.929533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d5b78-040c-4aa1-a5ea-22df54a2c7de None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:12.957911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:12.963723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:12.964593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:12.964881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:12.965158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] PATH_INFO: `/v3/users/bc052848f48542bda228c2bd6d0b37ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:12.966970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] RBAC: Authorizing `identity:get_user(user_id=bc052848f48542bda228c2bd6d0b37ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:12.968465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:12.970139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 560/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:12 2022] GET /identity/v3/users/bc052848f48542bda228c2bd6d0b37ed => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:12.975864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:13.073353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c454-bda2-4a06-99e0-1c18bb85f1d8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:13.093737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:13.107959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:13.113635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:13.113635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:13.113635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:13.113635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:13.113635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed58a-f2a1-4c22-a340-4c26e8345123 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:13.114076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 562/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:12 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:13.119727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:13.217801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fdc1-0dd5-48d2-98f1-8566f20d4cec None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:13.251213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:13.252094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:13.252380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:13.252659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577/users/bc052848f48542bda228c2bd6d0b37ed/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:13.255206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] RBAC: Authorizing `identity:create_grant(project_id=38fc5a2205324132b18aa3ed1e917577, user_id=bc052848f48542bda228c2bd6d0b37ed, role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:13.256650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7234eb-989b-498b-a8bd-8adfb6cebe76 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:13.356462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 561/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:05:13 2022] PUT /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577/users/bc052848f48542bda228c2bd6d0b37ed/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:15.376877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860241-7ed4-4813-a8a1-f57213c8e3df None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:15.377442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860241-7ed4-4813-a8a1-f57213c8e3df None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:15.377442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860241-7ed4-4813-a8a1-f57213c8e3df None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:15.379078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 563/1124] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:15.384173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:15.384591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:15.384733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:15.401945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:15.403686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:15.455552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:15.469358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 562/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:15.493928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3860241-7ed4-4813-a8a1-f57213c8e3df None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:15.595354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3860241-7ed4-4813-a8a1-f57213c8e3df None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:15.627872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:15.628749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:15.629284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:15.629587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] PATH_INFO: `/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:15.631064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] RBAC: Authorizing `identity:get_role(role_id=44434f7413ab4b8c9e7a7f7b794d0f5b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:15.632435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:15.633836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 564/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:15 2022] GET /identity/v3/roles/44434f7413ab4b8c9e7a7f7b794d0f5b => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:15.640169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:15.735863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a5d5e-d2b1-4ad8-b96e-dd7db926f1d0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:15.768795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:15.769677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:15.769959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:15.770230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] PATH_INFO: `/v3/users/bc052848f48542bda228c2bd6d0b37ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:15.771405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] RBAC: Authorizing `identity:get_user(user_id=bc052848f48542bda228c2bd6d0b37ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:15.772838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:15.774475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 563/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:15 2022] GET /identity/v3/users/bc052848f48542bda228c2bd6d0b37ed => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:15.781026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:15.838489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:15.881933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf53bc-6dc0-4f25-abe7-c9660cbb2646 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:15.914956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:15.915599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:15.915888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:15.916161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:15.982779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:15.984235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:16.037251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:16.080936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 565/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:16.086784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:16.142606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:16.189321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7339-ef0b-410b-b4d6-572746e439af None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:16.222447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:16.223299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:16.223588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:16.223858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] PATH_INFO: `/v3/projects/38fc5a2205324132b18aa3ed1e917577` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:16.225028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] RBAC: Authorizing `identity:get_project(project_id=38fc5a2205324132b18aa3ed1e917577)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:16.226491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d7f3b-a9e9-4e74-be19-78e0f8606847 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:16.228175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 564/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:16 2022] GET /identity/v3/projects/38fc5a2205324132b18aa3ed1e917577 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:16.235353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:16.334280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98f3ea-8cfd-4e17-8b30-b6093e1bc310 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:16.369306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:16.369986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:16.370274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:16.370550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:16.371418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] RBAC: Adding query filter params (role.id=44434f7413ab4b8c9e7a7f7b794d0f5b, scope.project.id=38fc5a2205324132b18aa3ed1e917577, user.id=bc052848f48542bda228c2bd6d0b37ed) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:16.371726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:16.373161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2eb5b-ce85-4f80-aaa2-d8a3d332f2d1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:16.379258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 566/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:16 2022] GET /identity/v3/role_assignments?user.id=bc052848f48542bda228c2bd6d0b37ed&scope.project.id=38fc5a2205324132b18aa3ed1e917577&role.id=44434f7413ab4b8c9e7a7f7b794d0f5b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:18.419034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e2f7-672d-4294-8655-ff300edc7c23 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:18.419629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e2f7-672d-4294-8655-ff300edc7c23 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:18.419629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e2f7-672d-4294-8655-ff300edc7c23 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:18.420926 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 565/1131] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:18.426154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:18.426566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:18.426700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:18.443187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:18.444362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:18.458067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:18.511487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 567/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:18.536045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e2f7-672d-4294-8655-ff300edc7c23 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:18.638111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e2f7-672d-4294-8655-ff300edc7c23 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:18.661030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:18.671491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:18.672277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:18.672554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:18.672823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:18.674017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:18.675447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae42f1-5743-4e94-bf3a-15e4f0b31518 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:18.677043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 566/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:18.682863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:18.780625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec62e00-47a1-4cc3-819d-4fe22f45f460 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:18.813008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:18.813705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:18.813990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:18.814262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:18.814975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:18.816391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f054-7053-4110-b8bb-0036231c5d80 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:18.919329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 568/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:05:18 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:05:20.958320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eafd9-1998-4da6-b89b-f9f2670a5896 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:20.958887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eafd9-1998-4da6-b89b-f9f2670a5896 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:20.958887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eafd9-1998-4da6-b89b-f9f2670a5896 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:20.960203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 567/1135] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:20.965486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:20.965908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:20.966064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:20.971061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:20.983505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:20.984758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:21.054694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 569/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:21.080266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eafd9-1998-4da6-b89b-f9f2670a5896 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:21.182019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eafd9-1998-4da6-b89b-f9f2670a5896 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:21.219005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:21.219723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:21.220011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:21.220292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:21.221468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:21.222949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf7456-1a8e-45ea-97f1-fa95d717e7d5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:21.224562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 568/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:21.230374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:21.329195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562ca8-be62-4e60-993c-e8a70fc039e9 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:21.358763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:21.363816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:21.364496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:21.364783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:21.370995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:21.370995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:21.370995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6356c-ae34-4a2e-b723-e0f19cb75471 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:21.454454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 570/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:05:21 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:05:23.561084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91516da-694d-4003-8558-c23d79077590 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:23.561641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91516da-694d-4003-8558-c23d79077590 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:23.561641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91516da-694d-4003-8558-c23d79077590 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:23.562943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 569/1139] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:23.568350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:23.568774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:23.568908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:23.585588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:23.586792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:23.653464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 571/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:23.677394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91516da-694d-4003-8558-c23d79077590 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:23.736900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:23.777516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91516da-694d-4003-8558-c23d79077590 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:23.810305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:23.811142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:23.811372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:23.811651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:23.821518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:23.829842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:23.830784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:23.831643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 570/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:23.837218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:23.935097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561a15-8b1d-42f8-afbb-1fd0d0761772 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:23.954292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:23.971150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:23.971811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:23.972091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:23.972361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:23.973102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:23.973398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:23.974800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:23.982938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 572/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:23.989058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:24.088156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc22ea-fdce-4bca-8d2a-545f34473c39 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:24.108184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:24.122050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:24.122930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:24.123204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:24.123478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] PATH_INFO: `/v3/users/ff27e6b936674707bbe5d7b3e313599d` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:24.136302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] RBAC: Authorizing `identity:get_user(user_id=ff27e6b936674707bbe5d7b3e313599d)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:24.138384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:24.140394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 571/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:23 2022] GET /identity/v3/users/ff27e6b936674707bbe5d7b3e313599d => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:24.145938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:24.243077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a42808-7e24-4658-a347-cd7768fcc8a3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:24.281825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:24.282470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:24.282755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:24.283033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:24.330812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:24.349636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:24.351040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:24.447916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 573/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:24.454517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:24.555055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c28c93-30f8-49d8-ae76-fd0efd237430 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:24.591886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:24.592743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:24.593022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:24.593292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] PATH_INFO: `/v3/projects/83655f7b24ff4e2f84833afde34eaa0d` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:24.595650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] RBAC: Authorizing `identity:get_project(project_id=83655f7b24ff4e2f84833afde34eaa0d)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:24.595964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f054f9-8538-474e-a150-81c07b12fad3 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:24.597698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 572/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:24 2022] GET /identity/v3/projects/83655f7b24ff4e2f84833afde34eaa0d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:24.604079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:24.684936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:24.703646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7809d-a56a-4d0e-8e3c-428ff8044ecb None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:24.737890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:24.738540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:24.738825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:24.739104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:24.739934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=83655f7b24ff4e2f84833afde34eaa0d, user.id=ff27e6b936674707bbe5d7b3e313599d) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:24.740250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:24.741738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a32b6-5de6-4cd0-96eb-9962e1705f77 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:24.747726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 574/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:24 2022] GET /identity/v3/role_assignments?user.id=ff27e6b936674707bbe5d7b3e313599d&scope.project.id=83655f7b24ff4e2f84833afde34eaa0d&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:26.734006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7b3d-a522-4bcc-8f73-3b42b48fd8ad None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:26.734502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7b3d-a522-4bcc-8f73-3b42b48fd8ad None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:26.734502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7b3d-a522-4bcc-8f73-3b42b48fd8ad None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:26.735833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 573/1147] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:26.741074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:26.741452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:26.741654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:26.758738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:26.759938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:26.826661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 575/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:26.849442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b7b3d-a522-4bcc-8f73-3b42b48fd8ad None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:26.897647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:26.951022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b7b3d-a522-4bcc-8f73-3b42b48fd8ad None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:26.983778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:26.984616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:26.984844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:26.985113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:26.994834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:27.002452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:27.003657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:27.004539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 574/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:27.009979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:27.083815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:27.108559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02342bfe-9373-4b6e-9d00-20f7f1d77f19 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:27.143705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:27.144370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:27.144655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:27.144933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:27.145709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:27.146018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:27.147399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:27.155420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 576/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:27.161630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:27.267634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c454aba-1648-4de7-a173-6a5a9900bceb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:27.274377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:27.300053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:27.300929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:27.301221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:27.301526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] PATH_INFO: `/v3/users/ff27e6b936674707bbe5d7b3e313599d` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:27.302788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] RBAC: Authorizing `identity:get_user(user_id=ff27e6b936674707bbe5d7b3e313599d)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:27.304245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:27.306070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 575/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:27 2022] GET /identity/v3/users/ff27e6b936674707bbe5d7b3e313599d => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:27.312832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:27.411977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a94b8-7d4c-49bb-96e2-8203eae9caa0 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:27.445778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:27.446645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:27.446926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:27.447197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] PATH_INFO: `/v3/projects/83655f7b24ff4e2f84833afde34eaa0d` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:27.448360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] RBAC: Authorizing `identity:get_project(project_id=83655f7b24ff4e2f84833afde34eaa0d)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:27.449859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecd5e2-4836-425f-999c-26cebbebb557 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:27.451552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 577/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:27 2022] GET /identity/v3/projects/83655f7b24ff4e2f84833afde34eaa0d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:27.457703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:27.554663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170d364-7d48-499d-a914-f81d65408281 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:27.587717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:27.588594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:27.588880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:27.589153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] PATH_INFO: `/v3/projects/83655f7b24ff4e2f84833afde34eaa0d/users/ff27e6b936674707bbe5d7b3e313599d/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:27.591917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=83655f7b24ff4e2f84833afde34eaa0d, user_id=ff27e6b936674707bbe5d7b3e313599d, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:27.593349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0bfe-3934-4e39-8ca9-e3f9ec3d2cdd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:27.706316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 576/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:05:27 2022] PUT /identity/v3/projects/83655f7b24ff4e2f84833afde34eaa0d/users/ff27e6b936674707bbe5d7b3e313599d/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:29.763845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9bd87-ffa0-4a23-82d2-475fbd85b3b0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:29.764375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9bd87-ffa0-4a23-82d2-475fbd85b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:29.764375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9bd87-ffa0-4a23-82d2-475fbd85b3b0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:29.765718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 578/1154] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:29.771173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792e9d-a934-4940-b021-470234ad5031 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:29.771602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792e9d-a934-4940-b021-470234ad5031 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:29.771731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792e9d-a934-4940-b021-470234ad5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:29.788295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-24792e9d-a934-4940-b021-470234ad5031 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:29.789536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-24792e9d-a934-4940-b021-470234ad5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:29.816624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:29.856454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 577/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:29.880043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9bd87-ffa0-4a23-82d2-475fbd85b3b0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:29.883930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:29.981731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9bd87-ffa0-4a23-82d2-475fbd85b3b0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.016388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.017105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.017390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.017702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.027965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:30.035628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:30.036730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:05:30.037888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 579/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:30.043699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792e9d-a934-4940-b021-470234ad5031 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:30.139361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792e9d-a934-4940-b021-470234ad5031 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.172552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.173214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.173501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.173797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.174537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:30.174842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:30.176202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:30.184283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 578/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:30.190547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:30.251081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:30.288983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff2e65-a700-46c5-bf2a-becf6295c245 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.323329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.324232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.324505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.324777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] PATH_INFO: `/v3/users/ff27e6b936674707bbe5d7b3e313599d` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.325993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] RBAC: Authorizing `identity:get_user(user_id=ff27e6b936674707bbe5d7b3e313599d)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:30.327433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:30.329053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 580/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:30 2022] GET /identity/v3/users/ff27e6b936674707bbe5d7b3e313599d => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:30.334806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:30.363469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:30.434682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb2c9-2a96-4efd-9e4c-b6c540fe2656 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.467040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.467686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.467986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.468260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.533821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:30.535268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:30.561422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:30.634002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 579/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:30.640949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:30.750708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba3f0-c403-4377-ab1e-fd3cbeb69a57 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.782086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:30.787127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.788110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.788394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.788666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] PATH_INFO: `/v3/projects/83655f7b24ff4e2f84833afde34eaa0d` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.789884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] RBAC: Authorizing `identity:get_project(project_id=83655f7b24ff4e2f84833afde34eaa0d)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:30.791365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fece0-612d-476f-8181-4947b74fe630 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:30.793768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 581/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:30 2022] GET /identity/v3/projects/83655f7b24ff4e2f84833afde34eaa0d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:30.800003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:30.897324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9410-19a2-45d6-9006-d600283f94f7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:30.922828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:30.931317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:30.931974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:30.932261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:30.934858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:30.934858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=83655f7b24ff4e2f84833afde34eaa0d, user.id=ff27e6b936674707bbe5d7b3e313599d) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:30.934858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:30.935300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfde26e-0b69-46a8-ac22-cb9fdec7cd74 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:30.940946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 580/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:30 2022] GET /identity/v3/role_assignments?user.id=ff27e6b936674707bbe5d7b3e313599d&scope.project.id=83655f7b24ff4e2f84833afde34eaa0d&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:33.001143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947445d-85b5-43da-90ad-9b51bf91dfe6 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:33.001702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947445d-85b5-43da-90ad-9b51bf91dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:33.001798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947445d-85b5-43da-90ad-9b51bf91dfe6 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:33.003083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 582/1162] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:33.008676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:33.009085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:33.009233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:33.025872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:33.027286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:33.091842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 581/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:05:33.114662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947445d-85b5-43da-90ad-9b51bf91dfe6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:33.216321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947445d-85b5-43da-90ad-9b51bf91dfe6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:33.250807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:33.251506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:33.251738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:33.252015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:33.321083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:33.323488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:33.324953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:33.421050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 583/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 09:05:33.427003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:33.525524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d915a6-debb-441a-bb82-b19d415d3574 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:33.545602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:33.559425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:33.560221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:33.560507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:33.560785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:33.567476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:33.568926 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-6b8ba522-ef52-48db-8f83-3be210932b5e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:33.584405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:33.585711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:33.586692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 582/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:05:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:33.592562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:33.686841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:33.689803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b2788-8d4b-4e10-8de4-1907e7b009c1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:33.724338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:33.724989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:33.725273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:33.725550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:33.726296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:33.726602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:33.727965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d25cd-9e8b-4ff9-b596-227427f1d2c4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:33.735079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 584/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 21 09:05:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:35.772804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013cb7-2a0c-444f-8942-da497fbe2050 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:35.773396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013cb7-2a0c-444f-8942-da497fbe2050 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:35.773396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013cb7-2a0c-444f-8942-da497fbe2050 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:35.774745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 583/1167] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:35.780649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a901a-b703-40f7-a901-e4ad46e01e04 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:35.781101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a901a-b703-40f7-a901-e4ad46e01e04 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:35.781201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a901a-b703-40f7-a901-e4ad46e01e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:35.798312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-631a901a-b703-40f7-a901-e4ad46e01e04 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:35.799494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-631a901a-b703-40f7-a901-e4ad46e01e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:35.865773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 585/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:35.889799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013cb7-2a0c-444f-8942-da497fbe2050 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:35.990012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013cb7-2a0c-444f-8942-da497fbe2050 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:36.024058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:36.024647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:36.024934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:36.025215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:36.025984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:36.027407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc0b18-2b90-47ee-a5d3-b9b50920000c None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:36.110888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 584/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Thu Jul 21 09:05:35 2022] POST /identity/v3/domains => generated 267 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:05:38.193733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfef8e-b6c1-4a14-bc47-df31b001464e None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:38.194300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfef8e-b6c1-4a14-bc47-df31b001464e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:38.194300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfef8e-b6c1-4a14-bc47-df31b001464e None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:38.195648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 586/1170] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:38.202044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:38.202526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:38.202624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:38.219993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:38.221177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:38.255412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:38.290175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 585/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:05:38.314588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfef8e-b6c1-4a14-bc47-df31b001464e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:38.408154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:38.415554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfef8e-b6c1-4a14-bc47-df31b001464e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:38.449898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:38.450716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:38.450993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:38.451260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] PATH_INFO: `/v3/domains/bd799e4ad1974d23a377550b3817f82d` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:38.461815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd799e4ad1974d23a377550b3817f82d)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:38.463258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543701-21ac-4039-b7df-872472d16f3d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:38.464900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 587/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 21 09:05:38 2022] GET /identity/v3/domains/bd799e4ad1974d23a377550b3817f82d => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:38.470855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:38.569746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b224c-a8ad-496c-bf39-3782b37f6973 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:38.603114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:38.603775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:38.604062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:38.604340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:38.605069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:38.606690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5886c2-7f12-4e22-9ce6-34cd2c5d933e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:38.723512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 586/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:05:38 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:05:40.837366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5109-ac45-450f-bb9e-a96285760dfa None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:40.837970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5109-ac45-450f-bb9e-a96285760dfa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:40.837970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5109-ac45-450f-bb9e-a96285760dfa None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:40.839307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 588/1174] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:40.845085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:40.845527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:40.845877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:40.864006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:40.865237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:40.881812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:40.930521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 587/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:40.955893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5109-ac45-450f-bb9e-a96285760dfa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:41.057712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5109-ac45-450f-bb9e-a96285760dfa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:41.092015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:41.092797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:41.093076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:41.093346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] PATH_INFO: `/v3/domains/bd799e4ad1974d23a377550b3817f82d` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:41.094627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd799e4ad1974d23a377550b3817f82d)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:41.096056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6141b6e-0079-458f-a0a7-e4a1d7fb558e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:41.097695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 589/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 21 09:05:40 2022] GET /identity/v3/domains/bd799e4ad1974d23a377550b3817f82d => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:41.103857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:41.200293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795464-c584-4225-ab57-1e5815a9fab8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:41.233834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:41.234500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:41.234778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:41.235049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:41.235741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:41.237167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b7ad8-2632-402c-8ef1-6e2bb12b2df8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:41.392229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 588/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:05:41 2022] POST /identity/v3/users => generated 311 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:05:43.455931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751cc0-64a9-416c-9f17-e2bf0e484a12 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:43.456485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751cc0-64a9-416c-9f17-e2bf0e484a12 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:43.456485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec751cc0-64a9-416c-9f17-e2bf0e484a12 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:43.458011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 590/1178] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:43.463274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:43.463708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:43.463812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:43.481335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:43.482576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:43.484546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:43.553660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 589/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:43.577480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec751cc0-64a9-416c-9f17-e2bf0e484a12 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:43.602851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:43.681470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec751cc0-64a9-416c-9f17-e2bf0e484a12 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:43.715488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:43.716328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:43.716612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:43.716889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:43.726858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:43.735158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:43.736333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:05:43.737435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 591/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:43.742390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:43.838678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492e779-f965-4d42-ad91-8218073afbdf None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:43.872379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:43.873045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:43.873333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:43.873794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:43.874671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:43.874986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:43.876355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:43.881530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:43.884878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 590/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:43.890937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:43.973527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:43.991054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65ada-67c4-4620-96e2-7f8a1cdc543b None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:44.024946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:44.025856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:44.026143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:44.026419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] PATH_INFO: `/v3/users/5843fb54abb94926aef2e83098d34e08` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:44.040274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=5843fb54abb94926aef2e83098d34e08)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:44.041751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:44.043445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 592/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:43 2022] GET /identity/v3/users/5843fb54abb94926aef2e83098d34e08 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:44.049232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:44.147547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aa5e9-f0f0-4a64-918d-76730c3e9975 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:44.180255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:44.180897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:44.181182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:44.181458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:44.244076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:44.246281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:44.247745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:44.345276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 591/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:44.351103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:44.449812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372a96d-8355-4686-a16b-f768a42de5a5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:44.482743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:44.483600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:44.483880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:44.484153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] PATH_INFO: `/v3/projects/9e17f894051a4ade92322c13f227afc0` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:44.485321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9e17f894051a4ade92322c13f227afc0)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:44.486778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5c8c-751a-41ba-a109-0a20b1e530b2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:44.488454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 593/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:44 2022] GET /identity/v3/projects/9e17f894051a4ade92322c13f227afc0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:44.494555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:44.587401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:44.590502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64e283-061e-4608-8fd4-01a224e9d59b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:44.623524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:44.624167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:44.624450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:44.624727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:44.625596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=9e17f894051a4ade92322c13f227afc0, user.id=5843fb54abb94926aef2e83098d34e08) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:44.625911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:44.627322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6a67-a490-48a1-a990-e4b4eb42d344 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:44.632842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 592/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:44 2022] GET /identity/v3/role_assignments?user.id=5843fb54abb94926aef2e83098d34e08&scope.project.id=9e17f894051a4ade92322c13f227afc0&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:46.648668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2806c-0ad2-495a-85f7-5dd76a028ef5 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:46.649192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2806c-0ad2-495a-85f7-5dd76a028ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:46.649192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2806c-0ad2-495a-85f7-5dd76a028ef5 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:46.650541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 594/1186] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:46.655689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:46.656082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:46.656249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:46.672744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:46.673986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:46.739011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 593/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:46.763071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2806c-0ad2-495a-85f7-5dd76a028ef5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:46.774065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:46.864493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2806c-0ad2-495a-85f7-5dd76a028ef5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:46.902889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:46.903675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:46.904095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:46.904536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:46.917939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:46.925744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:46.926858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:05:46.927781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 595/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:46.933939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:47.032634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:47.038704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbecad-94d5-45ac-841e-a9a70c0e08ce None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:47.073026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:47.073781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:47.074255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:47.074528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:47.075270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:47.075578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:47.076955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:47.084869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 594/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:47.090869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:47.157521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:47.193211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d846daa-2841-4734-a877-8f1215d4d1df None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:47.226025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10293381-a327-4687-9562-297f7fec1826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:47.226896 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10293381-a327-4687-9562-297f7fec1826 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:47.227176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10293381-a327-4687-9562-297f7fec1826 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:47.227447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10293381-a327-4687-9562-297f7fec1826 None admin] PATH_INFO: `/v3/users/5843fb54abb94926aef2e83098d34e08` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:47.228632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10293381-a327-4687-9562-297f7fec1826 None admin] RBAC: Authorizing `identity:get_user(user_id=5843fb54abb94926aef2e83098d34e08)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:47.230660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10293381-a327-4687-9562-297f7fec1826 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:47.232275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 596/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:47 2022] GET /identity/v3/users/5843fb54abb94926aef2e83098d34e08 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:47.238745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:47.339035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd7cf-0e69-4666-87fc-e912b51f6c43 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:47.372283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:47.373215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:47.373501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:47.373809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] PATH_INFO: `/v3/projects/9e17f894051a4ade92322c13f227afc0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:47.374986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] RBAC: Authorizing `identity:get_project(project_id=9e17f894051a4ade92322c13f227afc0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:47.376436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786c522-cea9-4093-9d84-43aea88fb24b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:47.378407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 595/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:47 2022] GET /identity/v3/projects/9e17f894051a4ade92322c13f227afc0 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:47.384428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10293381-a327-4687-9562-297f7fec1826 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:47.483600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10293381-a327-4687-9562-297f7fec1826 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:47.516238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:47.517127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:47.517410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:47.517721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] PATH_INFO: `/v3/projects/9e17f894051a4ade92322c13f227afc0/users/5843fb54abb94926aef2e83098d34e08/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:47.519905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e17f894051a4ade92322c13f227afc0, user_id=5843fb54abb94926aef2e83098d34e08, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:47.521339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3988d4-1c68-4399-867b-e742c0d27fb2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:47.524429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:47.653237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 597/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:05:47 2022] PUT /identity/v3/projects/9e17f894051a4ade92322c13f227afc0/users/5843fb54abb94926aef2e83098d34e08/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:49.670807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612933c-ecd4-4bb2-af52-6b81ae113ee0 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:49.671376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612933c-ecd4-4bb2-af52-6b81ae113ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:49.671376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612933c-ecd4-4bb2-af52-6b81ae113ee0 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:49.672710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 596/1193] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:05:49.678231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:49.678745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:49.678845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:49.696175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:05:49.697380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:05:49.771461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 598/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:05:49.795141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612933c-ecd4-4bb2-af52-6b81ae113ee0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:49.821636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:49.897240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612933c-ecd4-4bb2-af52-6b81ae113ee0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:49.930897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:49.931609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:49.931894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:49.932172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:49.942249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:05:49.950379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:05:49.952067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:05:49.953298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 597/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:05:49.957675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:50.058511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07d8c7-01ce-42b3-b572-dee383e94d3c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:50.084480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:50.093585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:50.094246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:50.096093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:50.096093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:50.096093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:50.096093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:50.097219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:50.105518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 599/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:50.111775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:50.200056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:50.215591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98b94-163b-4d25-9e59-29f287bef28a None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:50.248991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:50.249894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:50.250172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:50.250447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] PATH_INFO: `/v3/users/5843fb54abb94926aef2e83098d34e08` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:50.251625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] RBAC: Authorizing `identity:get_user(user_id=5843fb54abb94926aef2e83098d34e08)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:50.253331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:50.254970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 598/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 21 09:05:50 2022] GET /identity/v3/users/5843fb54abb94926aef2e83098d34e08 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:05:50.260762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:50.362055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff1a20-62b2-424c-85b8-0e7cc84124e2 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:50.396242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:50.396890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:50.397175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:50.397452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:50.453014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:50.464905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:50.466387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:50.566368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 600/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:05:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:05:50.572423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:50.671637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886d58-3501-46ba-b2c5-c3a150a0fd63 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:50.705853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:50.706623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:50.706904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:50.707184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] PATH_INFO: `/v3/projects/9e17f894051a4ade92322c13f227afc0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:50.708360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] RBAC: Authorizing `identity:get_project(project_id=9e17f894051a4ade92322c13f227afc0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:50.709816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc138-5c3a-4137-81e6-17046e819129 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:50.711548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 599/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 21 09:05:50 2022] GET /identity/v3/projects/9e17f894051a4ade92322c13f227afc0 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:05:50.718073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:05:50.805293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:50.818777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f9ce-c0ed-4a31-90ec-00580709674c None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:05:50.853144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:05:50.853815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:05:50.854094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:05:50.854365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:05:50.855887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=9e17f894051a4ade92322c13f227afc0, user.id=5843fb54abb94926aef2e83098d34e08) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:05:50.856339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:05:50.857793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbd75d-f511-49f7-9d76-0a8c819c69e1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:05:50.863634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 601/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:05:50 2022] GET /identity/v3/role_assignments?user.id=5843fb54abb94926aef2e83098d34e08&scope.project.id=9e17f894051a4ade92322c13f227afc0&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:06:00.701330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:06:00.860984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=24 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:04.109119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0901a-c123-4f63-8626-c97c53f50d9d None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:04.109727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0901a-c123-4f63-8626-c97c53f50d9d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:04.109727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0901a-c123-4f63-8626-c97c53f50d9d None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:04.111089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 600/1201] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:04.116504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:04.119269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:04.119269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:04.136001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:04.137285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:04.208799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 602/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:04.234180 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0901a-c123-4f63-8626-c97c53f50d9d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:04.341050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0901a-c123-4f63-8626-c97c53f50d9d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:04.375726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:04.376449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:04.376740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:04.377022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:04.387191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:04.388629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:04.406013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:04.407174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:04.408273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:04.408273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:04.408273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:04.408273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:04.408273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 601/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:04.413252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:04.512895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d54190-64d1-4d8d-a97f-67a09d6123fc None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:04.542810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:04.548676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:04.549342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:04.549720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:04.550000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:04.550716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:04.551023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:04.552449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4664d91-6eff-4b01-ac0a-8e8cd417718d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:04.563885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 603/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:04.569794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:04.622385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:04.670365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d7386-a8d6-4035-95fb-c3453a89f674 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:04.703040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:04.703698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:04.703979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:04.704254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:04.704941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:04.706384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b7511-2b78-448f-a74b-3549cd50c18b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:04.799854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 602/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 21 09:07:04 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:07:06.880193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311ba6-2878-466f-84b5-b7163d70b238 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:06.880783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311ba6-2878-466f-84b5-b7163d70b238 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:06.880783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311ba6-2878-466f-84b5-b7163d70b238 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:06.882127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 604/1206] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:06.887935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:06.888339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:06.888503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:06.905526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:06.906773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:06.973410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 603/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:06.997856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311ba6-2878-466f-84b5-b7163d70b238 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.102667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311ba6-2878-466f-84b5-b7163d70b238 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.138368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.139167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.139452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.139727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.150051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:07.158342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:07.161507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:07.162754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 605/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:07:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:07.165717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.206995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:07.268361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2f673-4cea-474f-83ac-7b5cd0eca7fc None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.302023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.302707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.302997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.303275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.304022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:07.304333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:07.305741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:07.315224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 604/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:07.320974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.372423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:07.423247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b308-7934-4394-969c-7b706b219fe8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.456318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.457486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.457486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.457786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.468353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:07.469829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:07.487409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:07.488502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:07.489636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:07.489636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:07.489636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:07.489636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:07.489636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 606/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:07.494889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.594842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:07.597952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce49f5-30fd-41fd-9f2f-8bc304db17b7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.632602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.633276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.633586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.633869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.634628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:07.634942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:07.636635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:07.647659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 605/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:07.654143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.755200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13e0c5-59ba-4533-bd7c-934d63dfb800 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.756669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:07.788283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.789184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.789463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.789768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.797452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:07.798991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:07.813854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:07.815288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:07.816273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 607/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:07.821092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:07.923626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089497-b51b-4245-a1ee-67e829df9040 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:07.956908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:07.957596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:07.957901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:07.958164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:07.958998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:07.959305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:07.960739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:07.977649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 606/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:07:07.984046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:08.084327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7299-bb8c-4edd-a88b-b758409ddce7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:08.117717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:08.118413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:08.118699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:08.118977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:08.149857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:08.190382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:08.191890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:08.290806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 608/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:07:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:07:08.297399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:08.317171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:08.397094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546c5a-7ad2-4a1e-b78e-9c4d95cc5f43 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:08.433312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:08.434133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:08.434423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:08.434704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:08.444668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:08.446203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:08.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:08.465144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:08.466106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:08.466106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:08.466106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:08.466106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:08.466106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 607/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:08.471368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:08.534518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:08.573578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745be868-5860-4f6f-91e1-0d13cae2a295 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:08.609836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:08.610504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:08.610791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:08.611069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:08.611850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:08.612245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:08.613703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:08.626684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 609/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:08.632513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:08.705896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:08.737336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c475-9e85-4ebf-b46a-a6fdd8183417 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:08.771564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:08.772374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:08.772664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:08.772946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:08.780961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:08.782448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:08.797435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:08.798595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:08.799641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 608/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:08.804726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:08.908801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a60686-edba-47e2-bfb7-3a35b7cfc22e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:08.934812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:08.945929 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:08.946595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:08.946880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:08.947160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:08.947950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:08.948258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:08.949736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259770-5194-471e-bff2-2cb59b15627e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:08.961122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 610/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:08.967566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:09.069515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0e0e-b34b-4bbc-be3c-2291eddc01a0 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:09.098533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:09.105121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:09.105866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:09.106152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:09.106430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:09.107289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=edb8ce5739dd4a8db6e0f9d2449edfe3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:09.107605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:09.109047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42336e7f-d607-4fe7-9ff2-0826a786f06a None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:09.114522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 609/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:07:08 2022] GET /identity/v3/role_assignments?user.id=edb8ce5739dd4a8db6e0f9d2449edfe3&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:11.165084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200c4d-65a0-4789-bdf0-be04fae2cd6c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.165634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200c4d-65a0-4789-bdf0-be04fae2cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.165747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200c4d-65a0-4789-bdf0-be04fae2cd6c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.167253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 611/1220] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:11.172421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.172839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.172988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.190244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:11.191523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:11.260101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 610/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:11.283994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200c4d-65a0-4789-bdf0-be04fae2cd6c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:11.388023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200c4d-65a0-4789-bdf0-be04fae2cd6c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:11.421838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:11.422558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.422840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.423114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.433669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:11.441321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:11.442361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:11.443254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 612/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:11.448734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:11.548422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306b6c-659b-40bf-8e5e-83465f9310a6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:11.573495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:11.584295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:11.585088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.585381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.585689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.586445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] RBAC: Adding query filter params (name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:11.586759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:11.588284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:11.596522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 611/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:11.602396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:11.646916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:11.701738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6eeb2-d6f1-4a9b-9479-6ee3b076edb5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:11.734740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:11.735560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.735838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.736108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.746474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:11.748371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:11.766427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:11.767370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:11.768327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:11.768327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:11.768327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:11.768327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:11.768327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 613/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:11.773714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:11.872748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a058fb-2ddf-435d-be37-1dccd0c06896 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:11.906182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:11.906845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:11.907131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:11.907410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:11.908126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:11.908434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:11.909841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:11.921382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 612/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:11.927223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.022153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:12.029111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816c86-fdd3-437f-bdf9-1c0246cec40f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.062955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.063751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.064034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.064306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.071866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.073454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:12.088964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:12.090109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:12.091404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:12.093713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 614/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:12.096274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.144139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:12.197814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7da42-bb04-43b3-aee2-e8571e8e3804 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.233703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.234376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.234661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.234938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.235768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:12.236083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.237522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.254693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 613/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:12.260516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.361955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902c68-8ea4-46c8-90bf-81bac3f075af None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.397440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.398272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.404771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.404771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.409442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.410920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:12.428631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:12.429743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:12.430774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:12.430774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:12.430774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:12.430774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:12.430774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 615/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:12.435862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.534365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb2773-fd68-4eae-9524-5a5c39d11812 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.536941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:12.572769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.573425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.573737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.574011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.574730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:12.575094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.576498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.587620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 614/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:12.594262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.603064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:12.695714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57fa4-47ce-4471-ac8f-e90ec3e71141 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.730699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.731488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.731773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.732050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.738801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.740251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:12.754611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:12.755555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:12.756475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 616/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:12.762380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.863865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a930-9693-4400-8b73-1fbea28ae87d None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:12.900172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:12.900841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:12.901200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:12.901478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:12.902290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:12.902602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:12.904037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e08a-7844-4d2d-b332-a657b58cf8a6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:12.915660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 615/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:12.921951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:12.989467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:13.027489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741d4b0-ba38-4c2e-baaa-d34ce6106512 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:13.061389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:13.062303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:13.062583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:13.062854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/edb8ce5739dd4a8db6e0f9d2449edfe3/roles/b693a057830f4b528ed56da26d0f4e00` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:13.078600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=edb8ce5739dd4a8db6e0f9d2449edfe3, role_id=b693a057830f4b528ed56da26d0f4e00)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:13.080113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cc9cd-dd11-466d-82f7-0e2dd2ca3adc None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:13.204818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 617/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:07:12 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/edb8ce5739dd4a8db6e0f9d2449edfe3/roles/b693a057830f4b528ed56da26d0f4e00 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:07:15.314235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e93be-84b0-4a29-8683-93f9cc42a095 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:15.318053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e93be-84b0-4a29-8683-93f9cc42a095 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:15.318053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e93be-84b0-4a29-8683-93f9cc42a095 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:15.318053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 616/1233] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:15.321239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:15.321663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:15.321845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:15.339029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:15.340295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:15.407191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 618/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:15.430922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e93be-84b0-4a29-8683-93f9cc42a095 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:15.456222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:15.532529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e93be-84b0-4a29-8683-93f9cc42a095 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:15.567217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:15.568066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:15.568350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:15.568677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:15.578949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:15.586616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:15.587763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:15.588913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 617/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 21 09:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:15.594099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:15.642484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:15.695081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2996a-01f8-48f8-af84-02ead65644b5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:15.729449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:15.730206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:15.730493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:15.730772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:15.731523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:15.731837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:15.733212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:15.741342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 619/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 21 09:07:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:15.747899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:15.836391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:15.852292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89ce85-105c-4320-bfbe-2ef5e578a259 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:15.887103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:15.887903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:15.888187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:15.888460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:15.898648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:15.900078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:15.918853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:15.919943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:15.921110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:15.921110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:15.921110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:15.921110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:15.921110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 618/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:15.926005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:16.029220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdd69f-f2e4-4181-8865-f0417f6bc7d3 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:16.038130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:16.062619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:16.063281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:16.063560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:16.063836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:16.064551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:16.064857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:16.066304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:16.078570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 620/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:16.084350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:16.184964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679eb4b-1be4-47e3-9b6e-297dbc01756e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:16.219799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:16.220612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:16.220896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:16.221184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:16.223896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:16.235501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:16.235501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:16.248518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:16.250028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:16.251189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 619/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:07:16.255911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:16.359705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37343-f172-4bcd-89d4-57d88d0feced None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:16.396211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:16.396892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:16.397174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:16.397450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:16.398325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:16.398637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:16.400120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:16.419225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 621/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:16.425142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:16.524486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7daf52-fb5c-4329-a380-43b847fc6df5 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:16.560448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:16.561159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:16.561442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:16.561757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:16.624272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:16.631374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:16.632858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:16.730172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 620/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:07:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:07:16.736120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:16.765340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:16.838612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f04db-91f0-4c6a-ae98-1409288b05f6 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:16.872208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:16.872999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:16.873275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:16.873546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:16.883662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:16.885904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:16.903982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:16.910616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:16.911854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:16.911854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:16.911854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:16.911854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:16.911854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 622/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:16.912217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:17.005795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:17.012040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a20ca-8aa5-42b8-a8dc-c6dfc6525e63 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:17.045371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:17.046077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:17.047237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:17.047237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:17.047489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:17.047717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:17.049130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:17.060409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 621/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:17.066085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:17.144722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:17.165843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c183b-83b7-4ebe-92a5-9497372fde72 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:17.199414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:17.200204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:17.200491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:17.200768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:17.207566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:17.209062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:17.223133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:17.227410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:17.228996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 623/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:17.231099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:17.334727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83dee2-54b3-4b4f-8481-c42e5381616b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:17.369830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:17.370491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:17.370781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:17.371061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:17.371844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:17.372155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:17.373612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec77674-797d-499e-b864-5a8daf6312dd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:17.386051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 622/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:17.392322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:17.494084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79d5a1-272f-46cc-9e5f-6c184045161d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:17.528001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:17.528647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:17.528979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:17.529258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:17.530115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] RBAC: Adding query filter params (role.id=b693a057830f4b528ed56da26d0f4e00, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=edb8ce5739dd4a8db6e0f9d2449edfe3) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:17.530458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:17.531903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38022b05-7311-446b-85a3-1de084a5e48e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:17.537885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 624/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:07:17 2022] GET /identity/v3/role_assignments?user.id=edb8ce5739dd4a8db6e0f9d2449edfe3&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=b693a057830f4b528ed56da26d0f4e00 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:19.707183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e85ed-aa58-432c-958e-413587623bed None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:19.707690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e85ed-aa58-432c-958e-413587623bed None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:19.707690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e85ed-aa58-432c-958e-413587623bed None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:19.709000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 623/1247] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:19.714401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:19.714795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:19.714965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:19.720120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:19.732402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:19.733628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:19.802675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 625/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 09:07:19.827253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e85ed-aa58-432c-958e-413587623bed None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:19.845728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:19.927524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e85ed-aa58-432c-958e-413587623bed None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:19.960343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:19.961050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:19.961331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:19.961627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:19.971606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:19.979718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:19.980938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:19.981836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 624/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:07:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:19.987182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.092942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb45b7-bd61-4afe-9ed6-18e1e03a8887 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.123780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:20.129171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.129911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.130200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.130477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:20.131242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:20.131550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:20.132976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:20.142070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 626/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:07:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:20.147798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.226243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:20.250693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52874a7a-f91a-431e-b362-344905c9c0af None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.284815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.285639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.285928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.286207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:20.297338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:20.298845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:20.316709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:20.320899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:20.322218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:20.322218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:20.322218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:20.322218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:20.322218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 625/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:20.324110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.428444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a7fa-c79c-4e4f-96cd-a20673989064 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.462158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.463419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.463726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.464002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:20.464716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:20.465031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:20.466423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:20.480846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 627/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:20.486673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.588115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1aa56-2abb-4e2d-83c1-c9584e652802 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.614915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:20.622682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.623481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.623766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.624182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:20.632801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:20.634308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:20.649865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:20.651646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:20.652934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 626/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:20.657802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.716529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:20.758955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efc982-9823-44bf-81f5-f5ed89e2d8f8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.794005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.794671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.794953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.795227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:20.796058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:20.796367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:20.797830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:20.814396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 628/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:20.820609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:20.919571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572e48-b809-48e1-b9f0-8283c9e86032 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:20.953137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:20.953813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:20.954099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:20.954375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.008737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:21.021259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.022688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.121868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 627/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:07:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:07:21.128272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:21.233742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe91e9-5a1d-44d3-abd5-f6a7601ef76f None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:21.247284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:21.268300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:21.269089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:21.269369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:21.269674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.282679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.282679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:21.298916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:21.300064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:21.301160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:21.301160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:21.301160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:21.301160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:21.301804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 629/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:21.306860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:21.391731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:21.403084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda3edb-c1e9-4be3-b2a4-5f1f2437bf6f None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:21.436309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:21.436963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:21.437297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:21.437595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.438303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:21.438607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.439969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.452515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 628/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:21.458272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:21.559930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e7b20-2828-47fc-b2fe-76e681f2927e None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:21.595392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:21.596223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:21.596506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:21.596781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.603521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.605074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:21.618638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:21.619818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:21.620780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 630/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:21.626088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:21.727875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b3c1-f81a-4a81-b5b6-1329b69b61a2 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:21.762805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:21.763479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:21.763771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:21.764052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.764833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:21.765146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.766615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3315258-00e3-44c1-934e-62375b52b3b8 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.779828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 629/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:21.786019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:21.818666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:21.885375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe18f-0723-4342-95f3-bec9dcab7185 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:21.919127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:21.919770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:21.920081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:21.920355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:21.921178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=edb8ce5739dd4a8db6e0f9d2449edfe3) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:21.921607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:21.923333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738eded-165e-49e9-aefc-e4451f09ea1f None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:21.929431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 631/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:07:21 2022] GET /identity/v3/role_assignments?user.id=edb8ce5739dd4a8db6e0f9d2449edfe3&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:23.970998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a35-fb42-4140-b1eb-751aaf8c015b None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:23.971586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a35-fb42-4140-b1eb-751aaf8c015b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:23.971586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a35-fb42-4140-b1eb-751aaf8c015b None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:23.972905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 630/1261] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:23.978561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:23.978979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:23.979098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:23.996199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:23.997381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:24.066564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 632/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:24.090167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f4a35-fb42-4140-b1eb-751aaf8c015b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:24.101112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:24.193773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f4a35-fb42-4140-b1eb-751aaf8c015b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:24.231211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:24.231895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:24.232181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:24.232459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:24.242388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:24.250371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:24.256805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:24.257874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 631/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:24.258750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:24.276884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:24.359026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06ca2-08b0-4828-8b73-3d0d2cbe8e23 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:24.393018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:24.393775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:24.394685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:24.394967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:24.395719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:24.396028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:24.397532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:24.406528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 633/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:07:24.412500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:24.479639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:24.513888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220987b-0dcb-4e13-8332-fa52c18c98fb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:24.547251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:24.548044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:24.548337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:24.548614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:24.559270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:24.560719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:24.578805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:24.579724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:24.580832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:24.580832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:24.580832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:24.580832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:24.583363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 632/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:24.587071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:24.670125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:24.690083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233409b8-107a-4c3d-9e00-33f3f059d1af None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:24.725679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:24.726343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:24.726743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:24.726988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:24.727708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:24.728084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:24.729606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:24.740970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 634/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:24.747413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:24.851293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeff09-8b36-4756-bcee-8a89adde54db None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:24.871503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:24.886002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:24.886811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:24.887287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:24.887568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:24.895052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:24.896498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:24.911082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:24.912060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:24.913074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 633/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:24.918337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.018046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f300ae-042f-4cfb-a98f-08705b5107c7 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.050569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.051237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.051573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.051853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.052731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:25.053046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.054505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:25.065294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:25.073973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 635/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:25.080044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.179938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cf418-2212-4b58-9b4e-3c29e5fd8710 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.214353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.215112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.215399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.215677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.226705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.228683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:25.247036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:25.248022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:25.249137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:25.249137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:25.249137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:25.249137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:25.249137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 634/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:25.254549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.356924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaca73-bc41-4345-a615-507703a2e8f4 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.392365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.393033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.393314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.393610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.394342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:25.394697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.396041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:25.408849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 636/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:25.414579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.447342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:25.515992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15ea0-4245-462f-8132-68a958172ad6 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.553929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.554715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.554998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.555274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.562697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.564155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:25.578474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:25.579634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:25.580890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 635/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:25.585580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.645858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:25.687631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3434f-af19-4101-9d9b-19bf1e6f5ec1 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.722165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.722957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.723128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.723410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.724195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:25.724505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.725995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3f43-4525-4f5f-aced-4c64bff6927e None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:25.738316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 637/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:25.745313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:25.842151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:25.850267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098c13-8a5a-4a5f-8e2c-b21a8ab9759b None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:25.883844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:25.885419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:25.885736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:25.886002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] PATH_INFO: `/v3/projects/b2524486423e4706a60817d9acb25381/users/edb8ce5739dd4a8db6e0f9d2449edfe3/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:25.887998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b2524486423e4706a60817d9acb25381, user_id=edb8ce5739dd4a8db6e0f9d2449edfe3, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:25.889427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ef92-756b-47fe-9c2a-d283edcd23bd None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:26.072188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 636/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 21 09:07:25 2022] PUT /identity/v3/projects/b2524486423e4706a60817d9acb25381/users/edb8ce5739dd4a8db6e0f9d2449edfe3/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:07:28.103466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e0e0-4258-4606-8a4e-d54c3237d329 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.104002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e0e0-4258-4606-8a4e-d54c3237d329 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.104002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e0e0-4258-4606-8a4e-d54c3237d329 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.105377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 638/1274] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:28.110546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.110942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.111248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.128467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:28.129710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:28.200880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 637/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:28.224242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24e0e0-4258-4606-8a4e-d54c3237d329 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:28.328843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24e0e0-4258-4606-8a4e-d54c3237d329 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:28.346972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:28.363790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:28.364514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.364794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.365063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.376086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 09:07:28.383669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:28.385283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:28.386635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 639/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 21 09:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:28.391109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:28.475534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:28.494195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f4d16-f875-4b77-b352-c1d400f2424a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:28.528591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:28.529263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.529543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.529855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.530600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:28.530907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:28.532284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:28.541281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 638/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 21 09:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:28.547977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:28.646966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde918-6cf6-4b30-bd58-63db894b16da None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:28.680463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:28.682201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.682201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.682401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.693206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:28.694670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:28.714225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:28.715426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:28.716943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:28.716943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:28.716943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:28.716943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:28.716943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 640/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:28.721459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:28.823003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9396-26fc-4cc6-976a-ed473928a070 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:28.856858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:28.857522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:28.857840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:28.858121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:28.858843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:28.859153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:28.860521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:28.872206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 639/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:28.878451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:28.910474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:28.980958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b5987-3821-41b8-99aa-17de4ad12ecf None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.016092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.016998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.017282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.017556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.024590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:29.026654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 09:07:29.041383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:29.042553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:29.043586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 641/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:29.048476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:29.052281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:29.151457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8650cc-2d84-4302-81c6-0fadafdbe3bb None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.184547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.185144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.185425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.185734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.186553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:29.186861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:29.188298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:29.205271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 640/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 21 09:07:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:29.211283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:29.305536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:29.315769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f771a39-a37d-4211-aa6f-ac94099b3158 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.349412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.350114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.350393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.350804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.422792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:29.424260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:29.513335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:29.523383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 642/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 21 09:07:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 09:07:29.529805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:29.590280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:29.628226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803eaa-9a62-4796-b7d3-9be11cd1de21 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.661251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.662077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.662361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.662637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.673609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:29.675079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 09:07:29.693218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:29.696726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:29.697685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 09:07:29.697685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 09:07:29.697685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 09:07:29.697685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:29.697685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 641/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:29.700628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:29.800037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f0ea6-b475-4a18-9772-ffdc97e109e8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.834230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.834884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.835165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.835437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.836146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:29.836450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:29.838233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:29.849513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 643/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 21 09:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:29.856170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:29.956254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ea64-ac07-4e67-97bd-b9ab900a6431 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:29.969844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:29.990336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:29.991141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:29.991427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:29.991703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:29.999775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:30.001219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 09:07:30.015634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:30.016714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: ERROR keystone.server.flask.application Jul 21 09:07:30.022246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 642/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 21 09:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 09:07:30.022882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:30.074903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:30.127004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806f8b-792d-45d4-bd13-2252bfff5f4d None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:30.161677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:30.162444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:30.162686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:30.162961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:30.163755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:30.164098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:30.165596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490d80-ad5d-4313-a5fa-6c5fa3e67ddb None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:30.178541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 644/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 21 09:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:07:30.185234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:30.285058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1060-0acf-40fb-b0e5-f0876b9696f7 None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:30.321741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:30.323095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:30.323281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:30.323559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:30.324402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] RBAC: Adding query filter params (role.id=77bc6cd663c445d4b3a025be54e86d14, scope.project.id=b2524486423e4706a60817d9acb25381, user.id=edb8ce5739dd4a8db6e0f9d2449edfe3) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:30.324718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:30.326264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb763a-e9c1-4074-a944-16a08887b6e0 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:30.332228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 643/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 21 09:07:30 2022] GET /identity/v3/role_assignments?user.id=edb8ce5739dd4a8db6e0f9d2449edfe3&scope.project.id=b2524486423e4706a60817d9acb25381&role.id=77bc6cd663c445d4b3a025be54e86d14 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:32.432255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f970-7a9e-4fb4-a65d-56ce2d1ea775 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:32.432781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f970-7a9e-4fb4-a65d-56ce2d1ea775 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:32.432947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7f970-7a9e-4fb4-a65d-56ce2d1ea775 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:32.434430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 645/1288] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:32.439836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:32.440257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:32.440438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:32.457793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:32.458974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:32.488189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:32.526546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 644/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:32.549774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7f970-7a9e-4fb4-a65d-56ce2d1ea775 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:32.654303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7f970-7a9e-4fb4-a65d-56ce2d1ea775 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:32.664946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:32.690433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:32.691236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:32.691521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:32.691797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:32.692448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:32.693904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:32.705724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:32.706985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:32.708070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 646/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:07:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:32.713223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:32.813306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5928d-fdfe-482a-b52d-529fe4e8f319 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:32.846775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:32.847437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:32.847723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:32.848032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:32.848802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:32.849115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:32.850531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994835bc-2617-4c75-9a94-2bf82cbf5af6 None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:32.855962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 645/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 21 09:07:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:32.861953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:32.961879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869cf8d-51a4-4305-8312-1841e7ac3665 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:32.995194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:32.995845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:32.996122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:32.996394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] PATH_INFO: `/v3/services` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:32.997128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:32.997424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:32.998815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288c06a-5c41-4ebe-be79-5ddeeeeb1f38 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:33.003647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 647/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 21 09:07:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:35.081157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbadf9-c485-43d6-8eef-bc8f6b1e06b9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:35.081758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbadf9-c485-43d6-8eef-bc8f6b1e06b9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:35.081758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbadf9-c485-43d6-8eef-bc8f6b1e06b9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:35.083156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 646/1293] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:35.089092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2499-375e-4d42-985a-47097553368e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:35.089518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2499-375e-4d42-985a-47097553368e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:35.089666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2499-375e-4d42-985a-47097553368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:35.106303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6cfd2499-375e-4d42-985a-47097553368e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:35.107482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6cfd2499-375e-4d42-985a-47097553368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:35.137387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:35.174068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 648/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:35.197289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbadf9-c485-43d6-8eef-bc8f6b1e06b9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:35.228575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:35.297911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbadf9-c485-43d6-8eef-bc8f6b1e06b9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:35.335282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:35.335867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:35.336151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:35.336431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:35.337182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:35.338763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88f4a-378e-4f5f-b7d9-c3a97125a48b None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:35.428094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 647/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 21 09:07:35 2022] POST /identity/v3/services => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:07:37.475096 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6a3b-596f-4493-b621-a2612efe03e7 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:37.475677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6a3b-596f-4493-b621-a2612efe03e7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:37.475677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb6a3b-596f-4493-b621-a2612efe03e7 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:37.477118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 649/1296] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:37.482694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:37.483534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:37.483534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:37.500415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:37.501631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:37.572981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 648/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:37.596988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb6a3b-596f-4493-b621-a2612efe03e7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:37.700680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb6a3b-596f-4493-b621-a2612efe03e7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:37.734602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:37.735392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:37.735670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:37.735940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:37.736583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:37.737977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:37.750447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:37.751683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:37.752655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 650/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:07:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:37.757968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:37.777082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:37.855687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58b56e-2c30-4b3a-9b00-b673be1fe2e5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:37.890561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:37.891256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:37.891550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:37.891829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:37.892722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:37.892870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:37.894351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:37.899462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 649/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 21 09:07:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:37.905530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:37.938436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:38.005907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ce71-4757-4c2f-82c2-2d0dc5f3f2c8 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:38.041740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:38.042420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:38.042720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:38.042997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:38.043843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] RBAC: Adding query filter params (interface=public, service_id=50b17640555a44e6a2f45d5e35bf6829, region_id=RegionOne) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:38.044186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:38.045724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6276-cf7d-464a-8db4-67531414cafe None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:38.051038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 651/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 21 09:07:37 2022] GET /identity/v3/endpoints?service_id=50b17640555a44e6a2f45d5e35bf6829&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:38.057401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:38.138703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:38.156184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba60c-770a-4614-951e-bc72dd94cc8e None admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:38.191218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:38.191885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:38.192172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:38.192453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:38.193136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:38.194546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72664cf-d44a-4379-92f0-b7a1d1d7a04f None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:38.201416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 650/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 21 09:07:38 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:07:40.265914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a31fb-af07-4cb0-8cd0-01ef6df4d5be None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:40.266470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a31fb-af07-4cb0-8cd0-01ef6df4d5be None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:40.266470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a31fb-af07-4cb0-8cd0-01ef6df4d5be None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:40.267837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 652/1302] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:07:40.273312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:40.273784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:40.273916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:40.291468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:07:40.292669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:40.361827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 651/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:07:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 09:07:40.385784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a31fb-af07-4cb0-8cd0-01ef6df4d5be None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:40.483803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:40.490522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a31fb-af07-4cb0-8cd0-01ef6df4d5be None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:40.524906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:40.525658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:40.525943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:40.526217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:40.526872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:40.528295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:07:40.540966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:07:40.542251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application with Lock( Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: ERROR keystone.server.flask.application Jul 21 09:07:40.543235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 653/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 21 09:07:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 09:07:40.548782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:40.627199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:40.650872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257cb4d-38c2-4cc8-8ed7-7bc37ce48116 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:40.685449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:40.686154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:40.686440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:40.686717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] PATH_INFO: `/v3/services` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:40.687418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:07:40.687772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:40.689212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8455-8a85-4d83-b4e6-7e5aa23df1bf None admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:40.694368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 652/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 21 09:07:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:07:40.700970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:40.804536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01cd2-45df-499d-a7f1-89cfb91eccb5 None admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:40.838672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:40.839330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:40.839605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:40.839878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:40.840609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:40.842006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc23fb-93da-4ee2-be04-63157a21fdb1 None admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:40.969546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 654/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 21 09:07:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:07:50.691343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=30 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:50.964590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:45.276540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2490f-8782-4866-a3c2-a999510e1c4c None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:45.276996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2490f-8782-4866-a3c2-a999510e1c4c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:45.277430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2490f-8782-4866-a3c2-a999510e1c4c None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:45.282456 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 653/1307] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:13:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:45.285428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc52c-d264-4d8e-bb0c-cdddcbb02c7e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:45.285902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc52c-d264-4d8e-bb0c-cdddcbb02c7e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:45.286125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc52c-d264-4d8e-bb0c-cdddcbb02c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:45.380807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-497fc52c-d264-4d8e-bb0c-cdddcbb02c7e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:45.382059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-497fc52c-d264-4d8e-bb0c-cdddcbb02c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:45.534824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 655/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:45.605053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:45.605542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:45.606010 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:45.608575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 654/1309] 10.222.0.67 () {54 vars in 965 bytes} [Thu Jul 21 09:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:45.614851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3ec04-2989-44b1-8a91-ef8356408b77 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:45.615325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3ec04-2989-44b1-8a91-ef8356408b77 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:45.615748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3ec04-2989-44b1-8a91-ef8356408b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:45.754185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-60e3ec04-2989-44b1-8a91-ef8356408b77 None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:45.755447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-60e3ec04-2989-44b1-8a91-ef8356408b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:45.780589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:45.868989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 656/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Thu Jul 21 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:45.869764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:13:45.871709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:45.999288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66d0f-56df-4574-a2f0-d4f88cfdcf77 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:13:46.082085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:13:46.083069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:46.083571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:46.084035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:46.085892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:46.145940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:46.206996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:13:46.208740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826e55-25e9-4124-9c89-043949d4aa2c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:13:46.228723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 655/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:13:48.675689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:48.676280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:48.676280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:48.677659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 657/1312] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:48.682789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0eee1-ba30-4da5-a7b6-465a80cc2312 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:48.683202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0eee1-ba30-4da5-a7b6-465a80cc2312 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:48.683356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0eee1-ba30-4da5-a7b6-465a80cc2312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:48.774640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-aec0eee1-ba30-4da5-a7b6-465a80cc2312 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:48.775913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aec0eee1-ba30-4da5-a7b6-465a80cc2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:48.880500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 656/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:48.919036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:13:48.921125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:49.027066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad0e2-dc03-45a4-a35a-ad887bc97256 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:13:49.098943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:49.101399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:13:49.102092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:49.102482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:49.102695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:49.104309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:49.219240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:13:49.220692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a53891-5902-4a42-8c23-33ef8e9a068c service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:13:49.239216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 658/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:13:51.740642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:51.741181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:51.741272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:51.742619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 657/1315] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:51.747868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadf1-dbec-4bf3-b23e-00e94d4d2801 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:51.748315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadf1-dbec-4bf3-b23e-00e94d4d2801 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:51.748603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcadf1-dbec-4bf3-b23e-00e94d4d2801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:51.813468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-73dcadf1-dbec-4bf3-b23e-00e94d4d2801 None None] MFA Rules not processed for user `f63981a677064006bf748d47264bd29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:51.814707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73dcadf1-dbec-4bf3-b23e-00e94d4d2801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:51.866389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:51.912608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 659/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:51.953162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:13:51.954756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:51.964425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:52.055836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305f6b-e5a7-404b-8f4f-1307a2adf8fb None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:13:52.138453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:13:52.140079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:52.140362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:52.140634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:52.142303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:52.202779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:52.248005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:13:52.249986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0e3f-575c-43f1-b040-c17ce065397d service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:13:52.268248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 658/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:13:55.116285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:55.116846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:55.116846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:55.118256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 660/1318] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:55.123768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430a7-8a3d-442e-982a-42bea245ae60 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:55.124173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430a7-8a3d-442e-982a-42bea245ae60 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:55.124320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430a7-8a3d-442e-982a-42bea245ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:55.188983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b9d430a7-8a3d-442e-982a-42bea245ae60 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:55.190226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b9d430a7-8a3d-442e-982a-42bea245ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:55.286069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 659/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:13:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:55.325387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:13:55.327577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:55.435202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e761f-89dd-4790-a683-04d28972ac1d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:13:55.509235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:13:55.509984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:55.510269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:55.510549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:55.512227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:55.520584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:55.623616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:13:55.625180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8d42b-d65c-49d8-9461-cd434d8a1d1c service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:13:55.644202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 661/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:13:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:13:58.698679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:58.699217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:58.699314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:58.700626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 660/1321] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:13:58.706667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0fc1-3ab5-47b1-b57d-fe6c8a4dc479 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:58.707174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0fc1-3ab5-47b1-b57d-fe6c8a4dc479 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:58.707269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e0fc1-3ab5-47b1-b57d-fe6c8a4dc479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:58.774716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1f7e0fc1-3ab5-47b1-b57d-fe6c8a4dc479 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:13:58.775934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1f7e0fc1-3ab5-47b1-b57d-fe6c8a4dc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:58.836658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:58.876728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 662/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:13:58.914359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:13:58.915933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:58.937896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:59.028750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a75d62-2184-4dc6-a89d-9f89495f9f56 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:13:59.107445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:13:59.108750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:13:59.109068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:13:59.109341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:13:59.111037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:13:59.183662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:13:59.221924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:13:59.223378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf089c0-7071-46c4-8e19-a3d2675924da service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:13:59.243551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 661/1323] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:01.377716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:01.378239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:01.378239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:01.379632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 663/1324] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:01.385022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1398-bd14-4e7e-91f8-cdccef7725c6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:01.385464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1398-bd14-4e7e-91f8-cdccef7725c6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:01.385613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1398-bd14-4e7e-91f8-cdccef7725c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:01.450593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2a6a1398-bd14-4e7e-91f8-cdccef7725c6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:01.452314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2a6a1398-bd14-4e7e-91f8-cdccef7725c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:01.550140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 662/1325] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:01.587043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:01.588679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:01.700632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6a523-c879-404e-ac43-aa4eaa61e2e3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:01.775775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:01.776453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:01.776735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:01.777010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:01.778703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:01.797604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:01.895635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:01.897078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e433643-2623-480f-979f-1b5110e8d112 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:01.915223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 664/1326] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:04.046403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:04.047125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:04.047125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:04.048319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 663/1327] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:04.053590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738e5d-067b-42b5-a781-f5c9f17cc43a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:04.054009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738e5d-067b-42b5-a781-f5c9f17cc43a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:04.054120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738e5d-067b-42b5-a781-f5c9f17cc43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:04.121272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-af738e5d-067b-42b5-a781-f5c9f17cc43a None None] MFA Rules not processed for user `f63981a677064006bf748d47264bd29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:04.122458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-af738e5d-067b-42b5-a781-f5c9f17cc43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:04.192377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:04.227620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 665/1328] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:04.266866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:04.268485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:04.300393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:04.376344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1ea2-1ce3-4814-b192-aa9b128f2bf6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:04.451985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:04.452721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:04.453009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:04.453288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:04.454979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:04.531867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:04.565369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:04.566861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e72ea-e10f-4407-81c1-0aa48178f6d1 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:04.585899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 664/1329] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:07.112797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:07.113366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:07.113366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:07.114763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 666/1330] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:07.119909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33fd50-61ea-469e-9660-ca48d86b8311 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:07.120310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33fd50-61ea-469e-9660-ca48d86b8311 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:07.120511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33fd50-61ea-469e-9660-ca48d86b8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:07.194701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-aa33fd50-61ea-469e-9660-ca48d86b8311 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:07.195944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aa33fd50-61ea-469e-9660-ca48d86b8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:07.297232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 665/1331] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:07.336479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:07.338085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:07.443154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a7a1-dfb8-4be5-8834-3bcf09739f31 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:07.515694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:07.516341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:07.516623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:07.517099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:07.518573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:07.545900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:07.628110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:07.629550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9d605-45d7-49b9-948d-7afa2e5279dc service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:07.647524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 667/1332] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:09.745167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:09.745754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:09.745754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:09.747135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 666/1333] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:09.753314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc6ed-f2f3-42bc-9c90-c0272fdf7dd1 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:09.753790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc6ed-f2f3-42bc-9c90-c0272fdf7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:09.753917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc6ed-f2f3-42bc-9c90-c0272fdf7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:09.818543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-2defc6ed-f2f3-42bc-9c90-c0272fdf7dd1 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:09.819752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2defc6ed-f2f3-42bc-9c90-c0272fdf7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:09.892814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:09.915262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 668/1334] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:09.955796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:09.957345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:09.999121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:10.063613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bbfe-5464-46b2-bc99-8757d0e8c946 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:10.134823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:10.135470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:10.135758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:10.136036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:10.137722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:10.220723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:10.245497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:10.246968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb042f8-2bf1-4b94-abbc-bc0500d51e61 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:10.267155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 667/1335] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:12.926833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327961e8-3773-490b-b3a8-b166a12c8bd5 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:12.927412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327961e8-3773-490b-b3a8-b166a12c8bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:12.927412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327961e8-3773-490b-b3a8-b166a12c8bd5 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:12.928746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 669/1336] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:12.933956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c927-9d9d-4464-8223-b249976ac240 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:12.934390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c927-9d9d-4464-8223-b249976ac240 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:12.934526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c927-9d9d-4464-8223-b249976ac240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:12.998489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a401c927-9d9d-4464-8223-b249976ac240 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:13.000392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a401c927-9d9d-4464-8223-b249976ac240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:13.094339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 668/1337] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:13.144424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:13.144711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:13.144988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:13.146409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 670/1338] 10.222.0.67 () {54 vars in 965 bytes} [Thu Jul 21 09:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:13.152196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2484ba-62d9-4069-8ec9-669a812e29a4 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:13.152485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2484ba-62d9-4069-8ec9-669a812e29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:13.152854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2484ba-62d9-4069-8ec9-669a812e29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:13.205760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:13.226523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ec2484ba-62d9-4069-8ec9-669a812e29a4 None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:13.227766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ec2484ba-62d9-4069-8ec9-669a812e29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:13.304141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 669/1339] 10.222.0.67 () {58 vars in 1062 bytes} [Thu Jul 21 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:14:13.314262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:13.315834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:13.418028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ad0a-937a-4c90-8d3f-7a6a6d00d2e0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:13.491091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:13.491668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:13.491955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:13.492235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:13.493915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:13.529632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:13.602466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:13.603906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b772a3-21e3-40a5-b3a8-885e2d8c8225 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:13.622655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 671/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:18.432462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:18.433015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:18.433015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:18.434500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 670/1341] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:18.440165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189d24b-d1eb-4aef-b009-e7751b5ccc50 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:18.440696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189d24b-d1eb-4aef-b009-e7751b5ccc50 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:18.440696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189d24b-d1eb-4aef-b009-e7751b5ccc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:18.519438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8189d24b-d1eb-4aef-b009-e7751b5ccc50 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:18.520769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8189d24b-d1eb-4aef-b009-e7751b5ccc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:18.626868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:18.635608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 672/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:18.676439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:18.678023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:18.786170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf0b31-cbb5-40c2-bd3e-b04cf8b974b1 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:18.823679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:18.863473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:18.864115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:18.864397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:18.864672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:18.866349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:18.981110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:18.982600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f20cb-7a86-469c-8aa6-5c8e25cb75e9 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:19.009029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 671/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:22.024052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:22.024587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:22.024587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:22.026070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 673/1344] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:22.032131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf9a7-3530-4644-87e3-be4788030ef4 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:22.032580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf9a7-3530-4644-87e3-be4788030ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:22.032821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecf9a7-3530-4644-87e3-be4788030ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:22.103987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-38ecf9a7-3530-4644-87e3-be4788030ef4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:22.105221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-38ecf9a7-3530-4644-87e3-be4788030ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:22.124535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:22.207342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 672/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:22.245306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:22.246864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:22.363024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173f6c-e4aa-47ed-9256-8ba9e3afd618 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:22.457235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:22.458119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:22.465345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:22.465345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:22.465345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:22.508056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:22.581598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:22.583056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d923-7153-4ed2-840c-282f19d1bb46 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:22.605045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 674/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:26.815566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:26.816154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:26.816235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:26.817579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 673/1347] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:26.822871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c73-4e4b-4a99-8517-37939c55ea97 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:26.823344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c73-4e4b-4a99-8517-37939c55ea97 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:26.823427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6c73-4e4b-4a99-8517-37939c55ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:26.890449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cdcf6c73-4e4b-4a99-8517-37939c55ea97 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:26.891963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cdcf6c73-4e4b-4a99-8517-37939c55ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:26.990250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:26.993269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 675/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:27.041183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:27.042764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:27.176969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145668f-24d6-4701-9b66-05d842af3241 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:27.231966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:27.261265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:27.262240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:27.262726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:27.263656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:27.265620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:27.394692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:27.396203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a37ee-6862-4d82-b3af-afb7519543bd service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:27.416747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 674/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:32.384430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3335bb-399b-40c5-926c-79b6c5215f43 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:32.384863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3335bb-399b-40c5-926c-79b6c5215f43 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:32.385149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3335bb-399b-40c5-926c-79b6c5215f43 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:32.386689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 676/1350] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:32.392228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecd79-bf74-4917-9edb-06de8c88d3c0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:32.393673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecd79-bf74-4917-9edb-06de8c88d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:32.394151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecd79-bf74-4917-9edb-06de8c88d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:32.540276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-affecd79-bf74-4917-9edb-06de8c88d3c0 None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:32.541494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-affecd79-bf74-4917-9edb-06de8c88d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:32.564373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:32.669317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 675/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:37.084302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44b9d-3599-47d5-bf9f-137185a2392c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:37.084808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44b9d-3599-47d5-bf9f-137185a2392c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:37.084808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44b9d-3599-47d5-bf9f-137185a2392c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:37.087052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 677/1352] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:37.093496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f673bd-6653-4eff-81ca-7cf16c2f7f3d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:37.094989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f673bd-6653-4eff-81ca-7cf16c2f7f3d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:37.095471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f673bd-6653-4eff-81ca-7cf16c2f7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:37.224890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f7f673bd-6653-4eff-81ca-7cf16c2f7f3d None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:37.226148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f7f673bd-6653-4eff-81ca-7cf16c2f7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:37.329852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:37.378226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 676/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:38.592814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c616-2b0e-418a-9942-6c185cf083ae None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:38.593367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c616-2b0e-418a-9942-6c185cf083ae None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:38.593367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c616-2b0e-418a-9942-6c185cf083ae None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:38.595577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 678/1354] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:38.601467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303c56-e1af-4d03-9180-a204dba23e4a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:38.601997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303c56-e1af-4d03-9180-a204dba23e4a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:38.602101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303c56-e1af-4d03-9180-a204dba23e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:38.679263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ff303c56-e1af-4d03-9180-a204dba23e4a None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:38.680514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ff303c56-e1af-4d03-9180-a204dba23e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:38.796409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 677/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:42.213056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339bbf-af1b-4a8a-a103-3e463bf05e08 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:42.214223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339bbf-af1b-4a8a-a103-3e463bf05e08 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:42.214723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339bbf-af1b-4a8a-a103-3e463bf05e08 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:42.216738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 679/1356] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:42.223814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2c00-3626-4c0e-bdf7-891bd2d744fe None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:42.224318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2c00-3626-4c0e-bdf7-891bd2d744fe None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:42.224399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2c00-3626-4c0e-bdf7-891bd2d744fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:42.282636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:42.325063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1acd2c00-3626-4c0e-bdf7-891bd2d744fe None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:42.326514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1acd2c00-3626-4c0e-bdf7-891bd2d744fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:42.438750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 678/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:42.494964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:42.495257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:42.495534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:42.496886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 680/1358] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 21 09:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:42.506795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388123e-5f18-4268-9e6e-e69444387c58 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:42.507097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388123e-5f18-4268-9e6e-e69444387c58 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:42.507386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388123e-5f18-4268-9e6e-e69444387c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:42.601759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3388123e-5f18-4268-9e6e-e69444387c58 None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:42.603737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3388123e-5f18-4268-9e6e-e69444387c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:42.659630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:42.738976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 679/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 21 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:42.747008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:42.748515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:42.900130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef5424-630d-4dc9-a1a9-8202d383fff3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:42.984990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:43.030430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:43.031061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:43.031355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:43.031744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:43.034479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:43.132305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:43.133967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2755b-c5f9-4266-8646-d71daf37f53a service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:43.156534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 681/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:45.473488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:45.474153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:45.474153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:45.478088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 680/1361] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:45.481190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115acd-8fbb-4331-8cf3-9f58466eaffc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:45.481648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115acd-8fbb-4331-8cf3-9f58466eaffc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:45.482039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115acd-8fbb-4331-8cf3-9f58466eaffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:45.562891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ce115acd-8fbb-4331-8cf3-9f58466eaffc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:45.564181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ce115acd-8fbb-4331-8cf3-9f58466eaffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:45.606734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:45.675386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 682/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:45.720866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:45.723138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:45.909240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65af97-2620-4332-93c6-a8be764e4798 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:45.919583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:46.070283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:46.070942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:46.071222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:46.071501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:46.073183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:46.168643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:46.170566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2f9ca-b34e-4318-a349-8efa11d17067 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:46.190742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 681/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:48.701805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee8f9-946e-4d57-a9c7-0707ade06ded None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:48.702370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee8f9-946e-4d57-a9c7-0707ade06ded None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:48.702370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee8f9-946e-4d57-a9c7-0707ade06ded None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:48.703802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 683/1364] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:48.709215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca3b5-ac5b-484a-bfc7-1aa1e41c183a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:48.709736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca3b5-ac5b-484a-bfc7-1aa1e41c183a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:48.709971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca3b5-ac5b-484a-bfc7-1aa1e41c183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:48.727537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:48.802408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0b1ca3b5-ac5b-484a-bfc7-1aa1e41c183a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:48.803761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0b1ca3b5-ac5b-484a-bfc7-1aa1e41c183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:48.917622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 682/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:48.960409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:48.960608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:48.960882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:48.963228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 684/1366] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 21 09:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:48.968833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490922-d8e8-4a98-a672-bafa19a47c18 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:48.973594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490922-d8e8-4a98-a672-bafa19a47c18 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:48.973594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490922-d8e8-4a98-a672-bafa19a47c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:49.064208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cc490922-d8e8-4a98-a672-bafa19a47c18 None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:49.065772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cc490922-d8e8-4a98-a672-bafa19a47c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:49.103385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:49.193163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 683/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 21 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:49.201085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:49.202630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:49.394202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6888-6d50-4980-844b-93712c6d0dff None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:49.423029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:49.533186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:49.534034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:49.534493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:49.534960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:49.537924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:49.652463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:49.654051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2addfc-3cfa-4873-bb92-7fde137d0a56 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:49.674855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 685/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:50.685149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ab73-bbe2-4fc6-a4c9-283ba21dfab7 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:50.685705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ab73-bbe2-4fc6-a4c9-283ba21dfab7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:50.685705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ab73-bbe2-4fc6-a4c9-283ba21dfab7 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:50.687207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 684/1369] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:50.692797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336705-3611-4d04-8805-6647a5afdeb0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:50.693274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336705-3611-4d04-8805-6647a5afdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:50.693376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336705-3611-4d04-8805-6647a5afdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:50.728107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:50.767077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-01336705-3611-4d04-8805-6647a5afdeb0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:50.768891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-01336705-3611-4d04-8805-6647a5afdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:50.900044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 686/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:51.249486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:51.249486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:51.249486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:51.260875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 685/1371] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 21 09:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:51.260963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800ed3-29b0-4c3b-9c61-349b9b6993dc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:51.260963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800ed3-29b0-4c3b-9c61-349b9b6993dc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:51.260963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800ed3-29b0-4c3b-9c61-349b9b6993dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:51.342719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b3800ed3-29b0-4c3b-9c61-349b9b6993dc None None] MFA Rules not processed for user `fca5883c2c74481f88f33e24fe230198`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:51.344175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b3800ed3-29b0-4c3b-9c61-349b9b6993dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:51.394524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:51.426650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 687/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 21 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:51.434534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:51.436176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:51.550412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fab58-a066-4f09-98c7-7043f3c8e994 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:51.592773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:51.628615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:51.629278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:51.629576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:51.629864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:51.631504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:51.753852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:51.755648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd107-d87e-4cc2-a3bb-79f8fc1a7aae service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:51.776306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 686/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:52.027569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:52.028007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:52.028387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:52.029480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 688/1374] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:52.035126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2671-8660-4b3e-ac04-3c0fba801acb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:52.035592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2671-8660-4b3e-ac04-3c0fba801acb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:52.035756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2671-8660-4b3e-ac04-3c0fba801acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:52.107563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ebed2671-8660-4b3e-ac04-3c0fba801acb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:52.109496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ebed2671-8660-4b3e-ac04-3c0fba801acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:52.135208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:52.218884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 687/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:52.264623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:52.266414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:52.431313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74df19f-857f-43d3-a406-3b05b2d5c446 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:52.483049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:52.544761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:52.545412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:52.545724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:52.545998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:52.547745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:52.645878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:52.647512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643059c-1719-427d-94c5-c2c0be70c220 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:52.666939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 689/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:54.858354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:54.858868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:54.858980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:54.860664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 688/1377] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:54.867839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a8d0-a0ab-4f8e-8451-46f6265a7c48 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:54.868320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a8d0-a0ab-4f8e-8451-46f6265a7c48 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:54.868625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a8d0-a0ab-4f8e-8451-46f6265a7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:54.944046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d604a8d0-a0ab-4f8e-8451-46f6265a7c48 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:54.945262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d604a8d0-a0ab-4f8e-8451-46f6265a7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:54.951965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:55.065187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 690/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:55.109427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:55.111339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:55.259338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f314d4e-3014-4d08-85b4-622389893230 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:55.263294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:55.387914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:55.388487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:55.388770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:55.389046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:55.390711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:55.513166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:55.515643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb554-2646-4e47-8f04-0bd2e189eb25 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:55.539077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 689/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:14:57.745745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:57.746276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:57.746276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:57.747584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 691/1380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:14:57.752824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7603f-88ef-4cf4-9555-2d7fe233dc63 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:57.753237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7603f-88ef-4cf4-9555-2d7fe233dc63 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:57.753411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7603f-88ef-4cf4-9555-2d7fe233dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:57.763575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:57.825366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b9e7603f-88ef-4cf4-9555-2d7fe233dc63 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:14:57.826369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b9e7603f-88ef-4cf4-9555-2d7fe233dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:57.933613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 690/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:14:57.976500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:14:57.978039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:58.124891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:58.135933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300ecf-8e71-40b3-8c21-e125efd1afbb None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:14:58.257697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:14:58.258537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:14:58.258827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:14:58.259154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:14:58.260814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:14:58.384347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:14:58.385986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d92b8-93ef-4d60-b8b6-e7478b1801b8 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:14:58.398358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:14:58.409178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 692/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:00.851874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:00.852440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:00.852440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:00.853838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 691/1383] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:00.859417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2235e-b270-4b7c-9137-959b773d6a19 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:00.859837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2235e-b270-4b7c-9137-959b773d6a19 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:00.859990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2235e-b270-4b7c-9137-959b773d6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:00.931519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ffe2235e-b270-4b7c-9137-959b773d6a19 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:00.932863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ffe2235e-b270-4b7c-9137-959b773d6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:01.047903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 693/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:01.096807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:01.099122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:01.334995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:01.413883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ae535-d239-45a9-a09d-e02120a8f64a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:01.557450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:01.558284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:01.558645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:01.558982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:01.561500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:01.643448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:01.700579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:01.702260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73503a-0e79-4d8c-9f61-b5e2894b917e service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:01.723710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 692/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:15:03.879385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:03.880060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:03.880060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:03.881341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 694/1386] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:03.886721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb1e0-78de-4efc-820d-44258e7cfed0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:03.887284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb1e0-78de-4efc-820d-44258e7cfed0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:03.887284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcb1e0-78de-4efc-820d-44258e7cfed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:03.955605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-86dcb1e0-78de-4efc-820d-44258e7cfed0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:03.956775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-86dcb1e0-78de-4efc-820d-44258e7cfed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:04.060976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 693/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:04.108874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:04.113310 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:04.202034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:04.277268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb165d-b9e8-4e8f-9ce7-f890c107b6b2 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:04.405709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:04.406370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:04.406709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:04.406918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:04.409282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:04.460983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:04.518654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:04.520243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c45bfa-abf7-40f6-9694-8d6d90b1a1ae service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:04.539337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 695/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:06.819919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:06.820483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:06.820483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:06.821889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 694/1389] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:06.827205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c1a-e831-4ff2-a1a3-1315e83766d4 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:06.827626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c1a-e831-4ff2-a1a3-1315e83766d4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:06.827897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c1a-e831-4ff2-a1a3-1315e83766d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:06.894817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-57af2c1a-e831-4ff2-a1a3-1315e83766d4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:06.896030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-57af2c1a-e831-4ff2-a1a3-1315e83766d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:06.992944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 696/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:07.038567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:07.040090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:07.071733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:07.189787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf424-7cf0-4a29-93b8-e0249e58e9ec None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:07.268661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af541bf-757a-43e6-953b-bd6b7d4489fb None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.268946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af541bf-757a-43e6-953b-bd6b7d4489fb None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.269216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af541bf-757a-43e6-953b-bd6b7d4489fb None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.270663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 697/1391] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:15:07.276062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d6d3e-ff65-4e47-b3de-1a735095f7e1 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.277505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d6d3e-ff65-4e47-b3de-1a735095f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.277505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d6d3e-ff65-4e47-b3de-1a735095f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.291856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:07.293273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:07.310662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:07.311353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.311638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.311916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.313642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:07.346101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-521d6d3e-ff65-4e47-b3de-1a735095f7e1 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:07.347366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-521d6d3e-ff65-4e47-b3de-1a735095f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:07.407763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:07.410051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184acfac-89fa-47e7-9c6b-327af0344899 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:07.432293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 695/1392] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:07.455338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 698/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:07.521149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.521149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.521149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.522531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 696/1394] 10.222.0.67 () {54 vars in 966 bytes} [Thu Jul 21 09:15:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:07.530640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59a92-ccf4-45bd-a15b-37a6e067ed58 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.530640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59a92-ccf4-45bd-a15b-37a6e067ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.531112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59a92-ccf4-45bd-a15b-37a6e067ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.623107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3bc59a92-ccf4-45bd-a15b-37a6e067ed58 None None] MFA Rules not processed for user `dad643f7b3004fafb5d22ec1360ad9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:07.624268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3bc59a92-ccf4-45bd-a15b-37a6e067ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:07.664542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:07.722924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 699/1395] 10.222.0.67 () {58 vars in 1063 bytes} [Thu Jul 21 09:15:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:07.730424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:07.732164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:07.859221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdc96-6314-49a4-bdfd-41ac42289ca5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:07.873764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:07.939110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:07.939854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:07.940142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:07.940412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:07.942135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:08.056717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:08.058482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b5ff7-2fb9-4e27-807c-8341c1781818 service glance] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:08.081263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 697/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:08.997216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0d4e-f6f2-42dc-8536-8e6727d49181 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:08.997844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0d4e-f6f2-42dc-8536-8e6727d49181 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:08.997844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd0d4e-f6f2-42dc-8536-8e6727d49181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.067134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6cdd0d4e-f6f2-42dc-8536-8e6727d49181 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:09.068362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6cdd0d4e-f6f2-42dc-8536-8e6727d49181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.160664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 700/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:09.209796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:09.210298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:09.210496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.211947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 698/1398] 10.222.0.67 () {54 vars in 943 bytes} [Thu Jul 21 09:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:09.218210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f902f-4b34-47ca-a50e-ed98137ac1d0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:09.218506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f902f-4b34-47ca-a50e-ed98137ac1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:09.218785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f902f-4b34-47ca-a50e-ed98137ac1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.276639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:09.295703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b83f902f-4b34-47ca-a50e-ed98137ac1d0 None None] MFA Rules not processed for user `3e3e7115f88940f18234bab2425977ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:09.296924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b83f902f-4b34-47ca-a50e-ed98137ac1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.407300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 701/1399] 10.222.0.67 () {58 vars in 1040 bytes} [Thu Jul 21 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:09.417436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:09.418978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.464731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:09.557419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9953e1-f7ac-44cf-8e95-495b55d8e19f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:09.640400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bcc4-840e-4f13-8120-28d3a651c31c None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:09.640684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bcc4-840e-4f13-8120-28d3a651c31c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:09.640972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bcc4-840e-4f13-8120-28d3a651c31c None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.645597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 702/1400] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:09.648575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c8df-fbc7-40a2-8d53-be6bd68e4e56 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:09.648858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c8df-fbc7-40a2-8d53-be6bd68e4e56 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:09.649133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c8df-fbc7-40a2-8d53-be6bd68e4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.664173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:09.664861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:09.665150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:09.665430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:09.667173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.699746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:09.715188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d9d2c8df-fbc7-40a2-8d53-be6bd68e4e56 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:09.716406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d9d2c8df-fbc7-40a2-8d53-be6bd68e4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.755763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:09.757419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:09.765593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 699/1401] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:15:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:15:09.775077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:09.819827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 703/1402] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:09.865542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:09.866773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:09.959661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ef49-012f-45b9-9142-5d243232ffa2 service swift] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:10.029372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:10.074081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:10.074646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:10.074924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:10.075194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:10.076826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:10.173264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:10.175832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73fe7-46d3-49d7-b0a8-6f0177dc7aec service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:10.205165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 700/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:12.552197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:12.552818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:12.552818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:12.554167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 704/1404] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:12.559806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e045-4803-4c29-b332-d454825513d0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:12.560299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e045-4803-4c29-b332-d454825513d0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:12.560299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0e045-4803-4c29-b332-d454825513d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:12.629936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-67c0e045-4803-4c29-b332-d454825513d0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:12.633968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-67c0e045-4803-4c29-b332-d454825513d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:12.671976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:12.740785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 701/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:12.786514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:12.788072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:12.962222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33932ac0-2d73-424b-9c78-cf5325ab1da0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:13.009237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:13.110249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:13.111661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:13.111955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:13.112312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:13.114193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:13.228013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:13.229505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f0d4c-62f6-4fe1-a3a6-687d92d903f3 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:13.253740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 705/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:15.527782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:15.528351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:15.528351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:15.529766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 702/1407] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:15.535496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6ee0-d2ed-4558-9fc9-58fa495471af None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:15.535932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6ee0-d2ed-4558-9fc9-58fa495471af None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:15.536041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6ee0-d2ed-4558-9fc9-58fa495471af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:15.602330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:15.609615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c90d6ee0-d2ed-4558-9fc9-58fa495471af None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:15.619847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c90d6ee0-d2ed-4558-9fc9-58fa495471af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:15.719748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 706/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:15.766591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:15.768444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:15.939408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836f3a-f31c-4380-9cae-116783b41d22 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:15.959759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:16.070938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:16.071603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:16.071886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:16.072166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:16.073973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:16.177087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:16.186106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1185c7-1602-4280-bdd8-622995d9c7c3 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:16.206545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 703/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:15:25.717822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=44 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:26.204235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:33.764100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307dac7-6bef-46d6-8758-e48d2c53d661 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:33.764668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307dac7-6bef-46d6-8758-e48d2c53d661 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:33.764668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307dac7-6bef-46d6-8758-e48d2c53d661 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:33.766152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 707/1410] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 21 09:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:33.771870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3f62-ec43-465b-b0e7-8976356b462d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:33.772293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3f62-ec43-465b-b0e7-8976356b462d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:33.772406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c3f62-ec43-465b-b0e7-8976356b462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:33.850536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3f1c3f62-ec43-465b-b0e7-8976356b462d None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:33.851754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3f1c3f62-ec43-465b-b0e7-8976356b462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:33.956837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 704/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 21 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:33.971441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31591a-d496-424a-9503-b921feb9f209 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:33.971737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31591a-d496-424a-9503-b921feb9f209 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:33.972020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31591a-d496-424a-9503-b921feb9f209 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:33.973387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 708/1412] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 21 09:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:33.978531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28c65-4175-420c-90db-a136a16fcca1 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:33.978825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28c65-4175-420c-90db-a136a16fcca1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:33.979107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf28c65-4175-420c-90db-a136a16fcca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:34.051082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:34.055160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8bf28c65-4175-420c-90db-a136a16fcca1 None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:34.055160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8bf28c65-4175-420c-90db-a136a16fcca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:34.170818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 705/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 21 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:36.704936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:36.705495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:36.705495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:36.706890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:36.712594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70835d1-19f8-4b56-b576-f95013c7bf48 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:36.713038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70835d1-19f8-4b56-b576-f95013c7bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:36.713163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70835d1-19f8-4b56-b576-f95013c7bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:36.780914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e70835d1-19f8-4b56-b576-f95013c7bf48 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:36.782313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e70835d1-19f8-4b56-b576-f95013c7bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:36.840549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:36.884969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:36.934360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:36.935903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:37.082830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524af4e-6a12-4c58-8603-59459efa5e87 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:37.156241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:37.197515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:37.198200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:37.198486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:37.198766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:37.200438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:37.292696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:37.294361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788bc6e-c9da-48b3-a5e4-6d9ba52115f4 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:37.313976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 710/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:15:38.246914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:38.247369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:38.247493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:38.248894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:38.255007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c39c-c131-4768-ae75-3bcf1630a2c8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:38.255494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c39c-c131-4768-ae75-3bcf1630a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:38.255592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c39c-c131-4768-ae75-3bcf1630a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:38.336193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f303c39c-c131-4768-ae75-3bcf1630a2c8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:38.337407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f303c39c-c131-4768-ae75-3bcf1630a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:38.366627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:38.441843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:38.593029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:38.594633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:38.743109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112883c3-0bba-4b82-8fa1-f137a445c5f2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:38.784953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:38.859511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:38.860078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:38.860364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:38.860642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:38.862340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:38.953273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:38.954880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1c46c-149b-4704-b1c9-4de91a9dd5ac service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:38.974458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 708/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:39.860386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:39.860944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:39.860944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:39.863143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:39.868353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690e9a-80e7-4517-969d-d8cba92f0225 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:39.868897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690e9a-80e7-4517-969d-d8cba92f0225 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:39.868997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690e9a-80e7-4517-969d-d8cba92f0225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:39.922062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:39.944498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-87690e9a-80e7-4517-969d-d8cba92f0225 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:39.945774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-87690e9a-80e7-4517-969d-d8cba92f0225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:40.043432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:40.193636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:40.195161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:40.350572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884c591-64d2-4793-a113-1ed8defefe80 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:40.363187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:40.467217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:40.467761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:40.468054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:40.468319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:40.470005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:40.560117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:40.561759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e43a3-411f-459b-89b2-d8560db9dddd service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:40.580097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 713/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:41.450907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:41.451466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:41.451466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:41.452758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:41.458347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece3e76-0a79-43c5-bcaf-443fd1c24ea7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:41.458862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece3e76-0a79-43c5-bcaf-443fd1c24ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:41.458962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece3e76-0a79-43c5-bcaf-443fd1c24ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:41.478430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:41.536718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-bece3e76-0a79-43c5-bcaf-443fd1c24ea7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:41.537987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-bece3e76-0a79-43c5-bcaf-443fd1c24ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:41.636788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:15:41.786999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:41.788446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:41.898544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:41.936230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b6e2-ec2f-48a8-b740-e11b15cd47cd None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:42.051988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:42.052556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:42.052838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:42.053113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:42.054856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:42.135215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:42.155222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:42.156845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a56a-96b2-4e4d-95a8-727e8813a65f service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:42.179321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 711/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:43.048078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:43.048869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:43.048869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:43.050918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:43.056736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf780f-e0b8-45c3-9d02-9ca9db1c9241 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:43.057234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf780f-e0b8-45c3-9d02-9ca9db1c9241 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:43.057338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf780f-e0b8-45c3-9d02-9ca9db1c9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:43.137888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-52bf780f-e0b8-45c3-9d02-9ca9db1c9241 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:43.139174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-52bf780f-e0b8-45c3-9d02-9ca9db1c9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:43.238901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:43.391537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:43.393316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:43.478041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:43.540148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65a29-8606-4a2f-9997-ebece26112a1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:43.651913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:43.652483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:43.652766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:43.653042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:43.654792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:43.702683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:43.745801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:43.747403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568499a-9c38-4d7a-972a-844e101955ed service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:43.765477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 716/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:44.655728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:44.656257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:44.656257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:44.657593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:44.662734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3151c-e374-479d-98ce-940e765cbe74 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:44.663194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3151c-e374-479d-98ce-940e765cbe74 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:44.663299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3151c-e374-479d-98ce-940e765cbe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:44.743958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-28c3151c-e374-479d-98ce-940e765cbe74 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:44.745196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-28c3151c-e374-479d-98ce-940e765cbe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:44.845668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:44.997870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:44.999326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:45.048126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:45.147551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dbfd4-261b-48af-a0a8-7b1428cf9f9b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:45.264019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:45.264541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:45.265282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:45.265282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:45.266766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:45.276341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:45.361098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:45.362768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa4cd-676d-4a73-b0d4-65082d10220d service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:45.381332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 714/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:46.242179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:46.242792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:46.242792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:46.244156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:46.249117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c9a6-9708-4348-9c4c-31f64d73920c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:46.249586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c9a6-9708-4348-9c4c-31f64d73920c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:46.249708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c9a6-9708-4348-9c4c-31f64d73920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:46.328776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8342c9a6-9708-4348-9c4c-31f64d73920c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:46.330029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8342c9a6-9708-4348-9c4c-31f64d73920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:46.401228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:46.431514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:46.584305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:46.585852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:46.604201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:46.736030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97bda4-3ba2-40ec-8e60-24209e561e01 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:46.824925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:46.851999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:46.852782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:46.853146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:46.853665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:46.855645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:46.947746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:46.949376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ed60-563c-47c5-b2d9-ac594ffab08e service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:46.968248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 719/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:47.848888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:47.849687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:47.849687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:47.850845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:15:47.856014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a1139-d711-41d6-b9d1-c1e5a34d3c53 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:47.856462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a1139-d711-41d6-b9d1-c1e5a34d3c53 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:47.856599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a1139-d711-41d6-b9d1-c1e5a34d3c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:47.931336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-099a1139-d711-41d6-b9d1-c1e5a34d3c53 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:47.932537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-099a1139-d711-41d6-b9d1-c1e5a34d3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:47.974620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:48.035184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:48.189753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:48.192251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:48.353578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f99cc-3433-48b8-b568-9e8021e3ed62 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:48.410960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:48.476106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:48.477300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:48.477606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:48.477885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:48.479584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:48.569898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:48.571502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9276-992d-421a-a720-6a7596b960b4 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:48.590236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 717/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:49.477520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:49.478094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:49.478094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:49.479395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:49.484532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3880ad-6f3f-4c9b-8519-95a26481d065 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:49.484965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3880ad-6f3f-4c9b-8519-95a26481d065 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:49.485099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3880ad-6f3f-4c9b-8519-95a26481d065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:49.561233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ef3880ad-6f3f-4c9b-8519-95a26481d065 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:49.562494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ef3880ad-6f3f-4c9b-8519-95a26481d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:49.564554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:49.662533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:49.813632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:49.815729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:49.962597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cc6a4-a0c6-4fcc-ac01-1ddf06432e29 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:49.989209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:50.076394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:50.076957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:50.077240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:50.077515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:50.079219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:50.168901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:50.170547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8896b7-6d1e-44bd-8b4d-e5190d79e8f1 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:50.189253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 722/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:52.166152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:52.166695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:52.166808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:52.168123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:52.173525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35dd6-0927-4ff4-bac3-13fde21b8674 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:52.173997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35dd6-0927-4ff4-bac3-13fde21b8674 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:52.174134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35dd6-0927-4ff4-bac3-13fde21b8674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:52.214339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:52.239193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-49c35dd6-0927-4ff4-bac3-13fde21b8674 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:52.240393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-49c35dd6-0927-4ff4-bac3-13fde21b8674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:52.344962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:52.385934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:52.387474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:52.491221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affda5b5-fd5a-4bd7-b60b-59049988376f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:52.523471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:52.564477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:52.565750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:52.566071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:52.566450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:52.567979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:52.678557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:52.679998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01a7e3-c3c4-44d0-8a63-6fa123727a5c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:52.701136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 720/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:54.875138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:54.875727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:54.875727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:54.877119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:54.882460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea621-9bc2-4646-8c97-ad3fe9c741ae None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:54.882915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea621-9bc2-4646-8c97-ad3fe9c741ae None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:54.883038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea621-9bc2-4646-8c97-ad3fe9c741ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:54.947768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-66bea621-9bc2-4646-8c97-ad3fe9c741ae None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:54.949001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-66bea621-9bc2-4646-8c97-ad3fe9c741ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:54.961850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:55.047263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:55.084955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:55.086541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:55.192179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea240ae3-5098-45e0-ab77-cea7cbc57d8a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:55.204812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:55.267087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:55.267729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:55.268027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:55.268845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:55.270926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:55.382667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:55.384159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055140c6-712e-44aa-bccf-4e3bf2ac1d30 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:55.403186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 725/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:15:57.892957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782074da-ef65-45df-9856-70c76535e52f None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:57.893545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782074da-ef65-45df-9856-70c76535e52f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:57.893677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782074da-ef65-45df-9856-70c76535e52f None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:57.895072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:15:57.900647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2bda5-3951-473a-adb1-191ad2cbb74d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:57.901087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2bda5-3951-473a-adb1-191ad2cbb74d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:57.901212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2bda5-3951-473a-adb1-191ad2cbb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:57.948147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:57.965591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-fdd2bda5-3951-473a-adb1-191ad2cbb74d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:15:57.966814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fdd2bda5-3951-473a-adb1-191ad2cbb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:58.064802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:15:58.103441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782074da-ef65-45df-9856-70c76535e52f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:15:58.104985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-782074da-ef65-45df-9856-70c76535e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:58.207774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782074da-ef65-45df-9856-70c76535e52f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:15:58.247259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:15:58.281661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:15:58.282315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:15:58.282599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:15:58.282878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:15:58.284526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:15:58.398895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:15:58.400350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f474f-0346-4577-97d9-eee897e594fa service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:15:58.418734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 723/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:00.563437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:00.563969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:00.563969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:00.565578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:00.570741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb852a4-1000-4c15-9a9c-0ae96b4c6fdd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:00.571159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb852a4-1000-4c15-9a9c-0ae96b4c6fdd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:00.571290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb852a4-1000-4c15-9a9c-0ae96b4c6fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:00.635141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9eb852a4-1000-4c15-9a9c-0ae96b4c6fdd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:00.636344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9eb852a4-1000-4c15-9a9c-0ae96b4c6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:00.657031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:00.731856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:00.770860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:00.773100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:00.876383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ff01-585c-4050-8e52-b6c888622faa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:00.897886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:00.953340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:00.954039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:00.954327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:00.954606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:00.956876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:01.070791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:01.072239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632320b4-a92f-487b-b72e-ec0ba3975f99 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:01.091880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 728/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:03.214630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:03.215125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:03.215247 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:03.216555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:03.222259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e2eed-63ff-47f2-836f-401381dcf00b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:03.222696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e2eed-63ff-47f2-836f-401381dcf00b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:03.222916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e2eed-63ff-47f2-836f-401381dcf00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:03.286386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:03.289086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1b7e2eed-63ff-47f2-836f-401381dcf00b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:03.290338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1b7e2eed-63ff-47f2-836f-401381dcf00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:03.388471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:03.428201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:03.429782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:03.532572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29df38a-54d7-4f91-b51e-939c5bdf0de6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:03.583913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:03.608646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:03.609296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:03.609604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:03.609884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:03.611542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:03.719910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:03.721353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59a23a-8d96-47fb-bfaf-7021c89839d8 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:03.745401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 726/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:05.873950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:05.874527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:05.874527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:05.875921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:05.881714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47b09-df9f-4d38-ae85-f86f83dc5e3e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:05.882133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47b09-df9f-4d38-ae85-f86f83dc5e3e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:05.882270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47b09-df9f-4d38-ae85-f86f83dc5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:05.945567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-caa47b09-df9f-4d38-ae85-f86f83dc5e3e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:05.946783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-caa47b09-df9f-4d38-ae85-f86f83dc5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:05.975432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:06.043517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:06.082960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:06.084507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:06.188068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec08e1-418a-4c95-abc5-b48b339f416d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:06.216735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:06.263092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:06.263763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:06.264048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:06.264326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:06.266010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:06.380789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:06.382281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b111db8-9edb-4ad6-92a5-e8bfd8eb8c4d service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:06.401740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 731/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:08.498450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:08.499018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:08.499018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:08.500362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:08.505684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c18e-1327-43d3-b185-b3bc9cffc722 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:08.506104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c18e-1327-43d3-b185-b3bc9cffc722 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:08.506219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c18e-1327-43d3-b185-b3bc9cffc722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:08.569598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b272c18e-1327-43d3-b185-b3bc9cffc722 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:08.570712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b272c18e-1327-43d3-b185-b3bc9cffc722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:08.578804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:08.666452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:08.704103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:08.706591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:08.809314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f93f9-48a0-4605-aaf5-2b5a3f9e481c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:08.866225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:08.884558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:08.885207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:08.885491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:08.885799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:08.887490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:08.997518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:08.999039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba53c8-0180-4bea-9a80-f58e35cf3930 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:09.024577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 729/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:11.115122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:11.115666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:11.115764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:11.117077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:11.122495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef88c0-22ee-46bc-a11f-588f0650a232 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:11.122927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef88c0-22ee-46bc-a11f-588f0650a232 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:11.123042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef88c0-22ee-46bc-a11f-588f0650a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:11.189366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-54ef88c0-22ee-46bc-a11f-588f0650a232 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:11.190604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-54ef88c0-22ee-46bc-a11f-588f0650a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:11.229137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:11.287120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:11.326388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:11.327928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:11.433650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c952f7-a7a0-44ec-9bab-6c4ca20045cf None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:11.470997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:11.508394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:11.509110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:11.509398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:11.509714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:11.511454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:11.623248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:11.624693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94da89-abb6-4fd6-b654-bcd6db9a4f20 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:11.644139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 734/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:16:13.710559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:13.711158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:13.711158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:13.712493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:13.717894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4b7-2151-4a86-a114-9d4eb8657c68 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:13.718346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4b7-2151-4a86-a114-9d4eb8657c68 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:13.718447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c4b7-2151-4a86-a114-9d4eb8657c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:13.783457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0698c4b7-2151-4a86-a114-9d4eb8657c68 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:13.785361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0698c4b7-2151-4a86-a114-9d4eb8657c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:13.803451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:13.882614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:13.919796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:13.921393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:14.035107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b00d-6f31-4fc3-a451-0f6903c0b3f4 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:14.102187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:14.108725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:14.109397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:14.109708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:14.116095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:14.116095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:14.220801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:14.222314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8798-b8d3-4306-b0ff-8ad35dc2c9f8 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:14.241192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 732/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:16.319059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:16.319589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:16.319697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:16.320990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:16:16.326451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81305-1864-4eba-b20e-c6b444357f54 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:16.326895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81305-1864-4eba-b20e-c6b444357f54 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:16.327004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81305-1864-4eba-b20e-c6b444357f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:16.390563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-61e81305-1864-4eba-b20e-c6b444357f54 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:16.391770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-61e81305-1864-4eba-b20e-c6b444357f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:16.441150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:16.490514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:16.528153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:16.529726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:16.633821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f5e21-4260-4476-adfd-db47b72d854a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:16.680609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:16.707657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:16.708303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:16.708585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:16.708861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:16.710893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:16.819079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:16.820509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252557-d073-463b-ba15-fd49a793e2f7 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:16.840099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 737/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:26.488624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=22 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:26.837864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=66 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:36.669591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b79f8-dd70-4169-b72f-1ff7e285edbd None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:36.670215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b79f8-dd70-4169-b72f-1ff7e285edbd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:36.670215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b79f8-dd70-4169-b72f-1ff7e285edbd None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:36.671439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 734/1471] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:36.677172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b726f-a098-42ba-a0d6-e4ff16731dbe None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:36.677626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b726f-a098-42ba-a0d6-e4ff16731dbe None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:36.677746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b726f-a098-42ba-a0d6-e4ff16731dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:36.741624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-284b726f-a098-42ba-a0d6-e4ff16731dbe None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:36.742829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-284b726f-a098-42ba-a0d6-e4ff16731dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:36.839524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 738/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:16:36.923142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:36.923375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:36.923652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:36.925025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 735/1473] 10.222.0.67 () {54 vars in 966 bytes} [Thu Jul 21 09:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:36.930734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb71ed-6005-4651-814b-a6b3926e222e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:36.931023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb71ed-6005-4651-814b-a6b3926e222e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:36.931298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb71ed-6005-4651-814b-a6b3926e222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:37.004535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f1fb71ed-6005-4651-814b-a6b3926e222e None None] MFA Rules not processed for user `dad643f7b3004fafb5d22ec1360ad9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:37.005783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f1fb71ed-6005-4651-814b-a6b3926e222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:37.027556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:37.085627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 739/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Thu Jul 21 09:16:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:37.093053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:37.094619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:37.199780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894219a8-c40f-4a1b-9687-8b1292607ac2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:37.273295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:37.273980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:37.274270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:37.274547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:37.276208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:37.332288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:37.387764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:37.389220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0a986-edef-4f91-892e-c87f385ceabf service glance] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:37.408156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 736/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:39.548831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:39.549397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:39.549397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:39.551501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 740/1476] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:39.556784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7653-4872-49f1-b30c-6365aabd54b7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:39.557220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7653-4872-49f1-b30c-6365aabd54b7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:39.557336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7653-4872-49f1-b30c-6365aabd54b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:39.621272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-da3a7653-4872-49f1-b30c-6365aabd54b7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:39.622592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-da3a7653-4872-49f1-b30c-6365aabd54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:39.718727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 737/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:39.742520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:39.744051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:39.871375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd6e7d-be9b-48a1-af8b-81b1f1d17a71 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:39.921850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:39.966791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:39.967454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:39.967737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:39.968013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:39.968748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:39.970617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:16:39.970617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:16:39.970617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:16:39.971769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118ef59-b0cf-444c-8bc3-4d4e131e815a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:39.991637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 741/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 21 09:16:39 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:16:42.073612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:42.074174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:42.074274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:42.075583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 738/1479] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:42.081128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a677f-e79e-4801-898b-9f2fc5099a7a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:42.081677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a677f-e79e-4801-898b-9f2fc5099a7a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:42.081798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a677f-e79e-4801-898b-9f2fc5099a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:42.149894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-fb9a677f-e79e-4801-898b-9f2fc5099a7a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:42.151140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fb9a677f-e79e-4801-898b-9f2fc5099a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:42.247219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 742/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:42.291999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:42.293531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:42.305818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:42.438336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7dcc-c05f-45ac-9d89-f35076508fc9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:42.515387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:42.549863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:42.550527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:42.550856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:42.551133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:42.552806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:42.640304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:42.641931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2feff-7447-46e0-be83-3b72435799cf service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:42.661122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 739/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:44.923364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:44.924014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:44.924014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:44.925334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 743/1482] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:44.930904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35210-6970-43ef-b114-fe4215f328cc None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:44.931364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35210-6970-43ef-b114-fe4215f328cc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:44.931476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35210-6970-43ef-b114-fe4215f328cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:44.995802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-dbf35210-6970-43ef-b114-fe4215f328cc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:44.997036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-dbf35210-6970-43ef-b114-fe4215f328cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:45.043593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:45.094482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 740/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:45.132951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:45.134507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:45.158065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:45.241103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa905a-0ad6-4553-b104-afa6a009152e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:45.318154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:45.318815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:45.319098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:45.319373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:45.321045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:45.397281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:45.432978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:45.434484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3bc05-0ed3-4981-9889-3727a22a2a11 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:45.572838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 744/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:47.660543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:47.661416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:47.661416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:47.662485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 741/1485] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:47.667700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79129-9adb-4793-b1e0-0f543962e57d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:47.668176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79129-9adb-4793-b1e0-0f543962e57d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:47.668283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79129-9adb-4793-b1e0-0f543962e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:47.732241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-80a79129-9adb-4793-b1e0-0f543962e57d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:47.733368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-80a79129-9adb-4793-b1e0-0f543962e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:47.828715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 745/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:47.867565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:47.869100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:47.973745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973078c6-351f-4448-ab33-53836ad0cf8b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:48.044027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:48.045717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:48.046361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:48.046641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:48.046918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:48.048566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:48.156750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:48.158240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2805de-4834-4b54-8425-e1db04aff993 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:48.176612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 742/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:50.319011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545544c-df47-4354-af71-82cce88eab79 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:50.319532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545544c-df47-4354-af71-82cce88eab79 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:50.319638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545544c-df47-4354-af71-82cce88eab79 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:50.321039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 746/1488] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:16:50.326718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddee4-7af5-4a4a-9e33-c00ee224e886 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:50.327155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddee4-7af5-4a4a-9e33-c00ee224e886 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:50.327290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ddee4-7af5-4a4a-9e33-c00ee224e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:50.391745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-940ddee4-7af5-4a4a-9e33-c00ee224e886 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:50.392966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-940ddee4-7af5-4a4a-9e33-c00ee224e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:50.446190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:50.490145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 743/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:50.531046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545544c-df47-4354-af71-82cce88eab79 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:50.532582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8545544c-df47-4354-af71-82cce88eab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:50.571145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:50.639295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545544c-df47-4354-af71-82cce88eab79 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:50.711512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:50.712155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:50.712438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:50.712707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:50.714364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:50.792518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:50.822710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:50.824072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd769-d95b-43ff-82cd-db8d8f245138 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:50.842126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 747/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:16:53.287089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc761-0131-4003-be86-2be808579390 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:53.287652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc761-0131-4003-be86-2be808579390 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:53.287755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc761-0131-4003-be86-2be808579390 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:53.289487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 744/1491] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 21 09:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:16:53.294968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601dce-04b2-4984-b9e8-bf8136e14187 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:53.298778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601dce-04b2-4984-b9e8-bf8136e14187 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:53.298778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3601dce-04b2-4984-b9e8-bf8136e14187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:53.362665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c3601dce-04b2-4984-b9e8-bf8136e14187 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:16:53.364120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c3601dce-04b2-4984-b9e8-bf8136e14187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:53.458484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 748/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 21 09:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:16:53.497479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bc761-0131-4003-be86-2be808579390 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:53.499088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a00bc761-0131-4003-be86-2be808579390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:53.602978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bc761-0131-4003-be86-2be808579390 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:53.677989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:53.678639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:53.678927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:53.679208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:53.680871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:53.690078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:53.789907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:53.791310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eead0-2492-475e-ada0-bb932e67170d service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:53.810129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 745/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:17:03.455965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=82 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:17:03.807723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=50 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:29.682379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:29.682985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:29.682985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:29.759133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:29.760366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:29.859993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 749/1494] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:29.868063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:29.868561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:29.868669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:29.943611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:29.944957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:30.052016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 746/1495] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:30.056865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.058180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:30.069917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b99943-c369-4e0a-95c5-8c9b819f7440 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:30.135404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:30.170403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:30.171070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:30.171354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:30.171632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:30.172380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:18:30.172698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:30.174074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:30.174074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:18:30.174074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:18:30.175154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:30.186903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 750/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:18:30.195289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.205062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0bad6-bd69-44f0-afe4-0dff47521804 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:30.266812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:30.301255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:30.301964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:30.302252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:30.302531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:30.303245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:30.304996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:30.304996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:18:30.304996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:18:30.306726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:30.442584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 747/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:18:30 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:18:30.447460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.448925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:30.483838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5080-da5f-4803-bae2-348a41cda293 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:30.578213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:30.578887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:30.579170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:30.579446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:30.580145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:30.581172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:30.581172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:18:30.581172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:18:30.582402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:30.680006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 751/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:18:30 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:18:30.684983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.686590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:30.749465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129ca34-5390-468b-8ab2-9dababf58c25 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:30.832713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:30.842954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:30.843629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:30.843914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:30.844193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:30.844918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:30.845980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:30.845980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:18:30.845980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:18:30.850414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:30.859701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 748/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:18:30.863849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.865378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:30.878105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e984-b87d-46f3-b456-998df082cf86 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:30.903510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:30.973119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:30.973813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:30.974094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:30.974367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:30.975092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:30.976281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:30.976281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:18:30.976281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:18:30.977431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d100cf-a92a-4663-8975-f43c51c1dc2d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:30.991216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 752/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:18:30.995760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:30.997930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.031637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42198321-818e-4c95-863a-9e9c706df5e0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:31.126684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:31.127575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.127860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.128143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] PATH_INFO: `/v3/projects/58b9ca4a06e8465eba2ae9de67ce3a7a/users/256acc32746b4d44886bba5032528f24/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.150525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b9ca4a06e8465eba2ae9de67ce3a7a, user_id=256acc32746b4d44886bba5032528f24, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:31.151565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:31.151565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:18:31.151565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:18:31.153534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b024-7a40-4602-bf94-5cb2e65263fe admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:31.229150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 749/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:18:30 2022] PUT /identity/v3/projects/58b9ca4a06e8465eba2ae9de67ce3a7a/users/256acc32746b4d44886bba5032528f24/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:18:31.242246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a9d-c6e3-47f7-9dc4-a43208baa15c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.242537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a9d-c6e3-47f7-9dc4-a43208baa15c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.242817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a9d-c6e3-47f7-9dc4-a43208baa15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.299418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f4423a9d-c6e3-47f7-9dc4-a43208baa15c None None] MFA Rules not processed for user `256acc32746b4d44886bba5032528f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:31.300652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f4423a9d-c6e3-47f7-9dc4-a43208baa15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.378979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 753/1502] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:18:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:31.392367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.392663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.392978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.394387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 750/1503] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 21 09:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:18:31.399104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ff275-627e-4f98-852c-6015c8626821 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.399645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ff275-627e-4f98-852c-6015c8626821 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.399921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ff275-627e-4f98-852c-6015c8626821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.430090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:31.475643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d82ff275-627e-4f98-852c-6015c8626821 None None] MFA Rules not processed for user `fca5883c2c74481f88f33e24fe230198`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:31.476877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d82ff275-627e-4f98-852c-6015c8626821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.554792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 754/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 21 09:18:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:31.562845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:31.564438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.616662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:31.672294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae2e30-b5f8-4dad-b0cd-8563ebc76d14 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:31.747274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:31.747923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.748205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.748480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.750297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.849980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:31.851383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:31.854842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:31.869772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 751/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:31.914894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789977f4-e835-41e7-8c46-e6395f1131ff None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.915307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789977f4-e835-41e7-8c46-e6395f1131ff None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.915448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789977f4-e835-41e7-8c46-e6395f1131ff None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.916729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 755/1506] 10.222.0.67 () {52 vars in 829 bytes} [Thu Jul 21 09:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:18:31.920669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:31.921916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.024931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd4e18-9e70-4bd9-9ddd-eea10959697a service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:32.123159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:32.123947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:32.124248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:32.124531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] PATH_INFO: `/v3/users/256acc32746b4d44886bba5032528f24` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:32.137448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256acc32746b4d44886bba5032528f24)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:32.138643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:32.138643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:18:32.138643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:18:32.139846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:32.149700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:32.367958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256acc32746b4d44886bba5032528f24'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:32.386980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256acc32746b4d44886bba5032528f24'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:32.387455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256acc32746b4d44886bba5032528f24'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:32.387979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256acc32746b4d44886bba5032528f24'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:32.400476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256acc32746b4d44886bba5032528f24'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:32.505397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 752/1507] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:18:31 2022] DELETE /identity/v3/users/256acc32746b4d44886bba5032528f24 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:18:32.510233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361392-a26e-485c-b876-27e68c00a46d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:32.510525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361392-a26e-485c-b876-27e68c00a46d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:32.510824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98361392-a26e-485c-b876-27e68c00a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:32.571838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-98361392-a26e-485c-b876-27e68c00a46d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:32.573051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-98361392-a26e-485c-b876-27e68c00a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.648394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:32.661418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 756/1508] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:32.672652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:32.674114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.780004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06f7fe-3a32-451e-9823-b32696ac98c2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:32.836508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:32.858749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:32.859798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:32.860206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:32.860495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:32.862327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.975732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:32.977116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a09a9-889a-4f3d-9708-3ace55de8278 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:32.997514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 753/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:33.507174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361392-a26e-485c-b876-27e68c00a46d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:33.508416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-98361392-a26e-485c-b876-27e68c00a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:33.522027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98361392-a26e-485c-b876-27e68c00a46d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:33.625389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:33.626286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:33.626563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:33.626832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] PATH_INFO: `/v3/projects/58b9ca4a06e8465eba2ae9de67ce3a7a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:33.637482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b9ca4a06e8465eba2ae9de67ce3a7a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:33.638673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:18:33.638673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:18:33.638673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:18:33.639856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:33.755364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b9ca4a06e8465eba2ae9de67ce3a7a', 'request_id': 'req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:33.851433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b9ca4a06e8465eba2ae9de67ce3a7a', 'request_id': 'req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:33.858820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b9ca4a06e8465eba2ae9de67ce3a7a', 'request_id': 'req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:33.893288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] The token cache is being invalidate because project 58b9ca4a06e8465eba2ae9de67ce3a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:18:33.893593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:33.894029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-41ac9349-9ba8-4f4f-bac9-19a4ae5ffb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:18:33.895488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 757/1510] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:18:33 2022] DELETE /identity/v3/projects/58b9ca4a06e8465eba2ae9de67ce3a7a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:18:42.995034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=62 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:43.891122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:20:19.427352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:19.427954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:19.427954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:19.429311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:19.434251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807206c-d5a2-4819-b47c-bd8ffb852fc3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:19.434740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807206c-d5a2-4819-b47c-bd8ffb852fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:19.434861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807206c-d5a2-4819-b47c-bd8ffb852fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:19.519675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c807206c-d5a2-4819-b47c-bd8ffb852fc3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:19.521440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c807206c-d5a2-4819-b47c-bd8ffb852fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:19.632711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:19.789735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:19.791978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:19.916042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2be3-96d2-4a0f-a342-6df68a70654b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:19.921541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:19.922226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:19.922515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:19.922793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:19.932123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:19.933780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612376e7-b2eb-4484-a5d6-2ddcba060157 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:19.943322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 755/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:20.787776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7bd5-c669-4509-b083-dfa0253b5335 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:20.788319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7bd5-c669-4509-b083-dfa0253b5335 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:20.788319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7bd5-c669-4509-b083-dfa0253b5335 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:20.789661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:20.794488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f4b9-579b-43e7-ba8f-9bbd7b067acb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:20.794949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f4b9-579b-43e7-ba8f-9bbd7b067acb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:20.795082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f4b9-579b-43e7-ba8f-9bbd7b067acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:20.814178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-99f4f4b9-579b-43e7-ba8f-9bbd7b067acb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:20.816206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-99f4f4b9-579b-43e7-ba8f-9bbd7b067acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:20.824265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:20.976935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af7bd5-c669-4509-b083-dfa0253b5335 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:20.992484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af7bd5-c669-4509-b083-dfa0253b5335 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:20.998554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:20.999198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:20.999480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:20.999757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:21.012451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:21.014225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c44d8-a5af-4ec8-9134-eb48725790f9 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:21.025148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 760/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:21.357375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec29d-6965-4f0d-b016-2a41a5624eac None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:21.357703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec29d-6965-4f0d-b016-2a41a5624eac None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:21.357982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec29d-6965-4f0d-b016-2a41a5624eac None None] PATH_INFO: `/v3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:21.359279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 757/1517] 10.222.0.45 () {54 vars in 925 bytes} [Thu Jul 21 09:20:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:20:21.365605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459f77-fe8b-4708-b8c7-984dd8f93a12 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:21.365907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459f77-fe8b-4708-b8c7-984dd8f93a12 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:21.366187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459f77-fe8b-4708-b8c7-984dd8f93a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:21.428051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6e459f77-fe8b-4708-b8c7-984dd8f93a12 None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:21.429290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6e459f77-fe8b-4708-b8c7-984dd8f93a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:21.446372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:20:21.504686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 761/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 09:20:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:30.620388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827f0f-e2c6-4681-a075-fa8dfb5733bc None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:30.621018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827f0f-e2c6-4681-a075-fa8dfb5733bc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:30.621018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827f0f-e2c6-4681-a075-fa8dfb5733bc None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:30.622260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 758/1519] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 21 09:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:30.627378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eddf4-9f4e-4bc3-a66d-b4b3a9f84233 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:30.627899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eddf4-9f4e-4bc3-a66d-b4b3a9f84233 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:30.628094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eddf4-9f4e-4bc3-a66d-b4b3a9f84233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:30.649485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ce3eddf4-9f4e-4bc3-a66d-b4b3a9f84233 None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:30.650758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ce3eddf4-9f4e-4bc3-a66d-b4b3a9f84233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:30.659643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 762/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 21 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:30.667339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827f0f-e2c6-4681-a075-fa8dfb5733bc None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:30.680825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827f0f-e2c6-4681-a075-fa8dfb5733bc None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:30.685806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:30.686444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:30.686728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:30.687004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:30.696140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:30.697775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f664-5ed7-4150-89e9-4ee9a587c01a service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:30.708011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 759/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:20:32.268338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687621-3cac-4650-97ea-66588a1f81aa None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:32.268913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687621-3cac-4650-97ea-66588a1f81aa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:32.268913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687621-3cac-4650-97ea-66588a1f81aa None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:32.270296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:32.275013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5d8e-a724-449b-baa1-6f6c6b2a6af5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:32.275415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5d8e-a724-449b-baa1-6f6c6b2a6af5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:32.275578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5d8e-a724-449b-baa1-6f6c6b2a6af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:32.294351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6f9c5d8e-a724-449b-baa1-6f6c6b2a6af5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:32.295556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6f9c5d8e-a724-449b-baa1-6f6c6b2a6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:32.306447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:32.460401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687621-3cac-4650-97ea-66588a1f81aa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:32.475532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687621-3cac-4650-97ea-66588a1f81aa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:32.481130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:32.481801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:32.482083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:32.482354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:32.492042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:32.493715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2de184-7794-4a31-bf12-f1ffbad1bfd4 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:32.503646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 764/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:33.355612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3ce9-65bc-4689-b344-0c2c3a2473b5 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:33.356264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3ce9-65bc-4689-b344-0c2c3a2473b5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:33.356264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3ce9-65bc-4689-b344-0c2c3a2473b5 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:33.357529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 09:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:33.362888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f5cf-1303-4d0b-be43-db041c801ae8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:33.363315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f5cf-1303-4d0b-be43-db041c801ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:33.363422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f5cf-1303-4d0b-be43-db041c801ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:33.382287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6448f5cf-1303-4d0b-be43-db041c801ae8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:33.383513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6448f5cf-1303-4d0b-be43-db041c801ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:33.392647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 09:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:20:33.551087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f3ce9-65bc-4689-b344-0c2c3a2473b5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:33.565799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f3ce9-65bc-4689-b344-0c2c3a2473b5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:33.571331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:33.572240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:33.572240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:33.572538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:33.581181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:33.583387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd60677-f70c-480e-9e42-2205783f048c service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:33.593338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 762/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:37.515723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:37.516278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:37.516278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:37.517723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:37.523269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c37a-2266-4453-9885-209bb6819728 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:37.523689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c37a-2266-4453-9885-209bb6819728 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:37.526386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c37a-2266-4453-9885-209bb6819728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:37.544860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0f74c37a-2266-4453-9885-209bb6819728 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:37.546117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f74c37a-2266-4453-9885-209bb6819728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:37.556171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:37.631222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:37.633136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:37.714524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4642d-c3c3-43b7-8098-4d17a51192b1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:37.718251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:37.718936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:37.719221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:37.719496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:37.729292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:37.730751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979755-b321-4898-984e-5ce7baed643b service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:37.740928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 767/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:39.768350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d369f-9819-4516-8515-e9bc318bfa82 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:39.768866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d369f-9819-4516-8515-e9bc318bfa82 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:39.768866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d369f-9819-4516-8515-e9bc318bfa82 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:39.770433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:39.779258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db9df-28e4-4547-99e4-d9ca17fb055b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:39.779744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db9df-28e4-4547-99e4-d9ca17fb055b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:39.779849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23db9df-28e4-4547-99e4-d9ca17fb055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:39.797827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c23db9df-28e4-4547-99e4-d9ca17fb055b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:39.799065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c23db9df-28e4-4547-99e4-d9ca17fb055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:39.807657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:39.843397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d369f-9819-4516-8515-e9bc318bfa82 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:39.854640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d369f-9819-4516-8515-e9bc318bfa82 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:39.858137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df651693-1524-448f-961b-e47194480b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:39.858772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651693-1524-448f-961b-e47194480b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:39.859071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651693-1524-448f-961b-e47194480b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:39.859325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651693-1524-448f-961b-e47194480b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:39.868992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df651693-1524-448f-961b-e47194480b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:39.870486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df651693-1524-448f-961b-e47194480b42 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:39.879955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 765/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:43.412905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:43.413443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:43.413443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:43.414870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:43.420221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba069-2142-47a9-b7c0-5a50cc4993cf None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:43.420633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba069-2142-47a9-b7c0-5a50cc4993cf None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:43.420842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba069-2142-47a9-b7c0-5a50cc4993cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:43.427683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=81 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:20:43.446730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-72fba069-2142-47a9-b7c0-5a50cc4993cf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:43.447941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-72fba069-2142-47a9-b7c0-5a50cc4993cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:43.455705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:43.763033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:43.764785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:43.835468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:20:43.848932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d4b62-6862-4775-817d-f0c5bb8fa710 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:43.852609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:43.853257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:43.853542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:43.853848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:43.863299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:43.865220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d598-b334-4aaf-9d24-6ae514734c05 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:43.874852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 770/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:45.966204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:45.966777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:45.966777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:45.968131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 09:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:20:45.974559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5db8-0a50-40b0-8d4b-780c5d3bf2ec None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:45.975009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5db8-0a50-40b0-8d4b-780c5d3bf2ec None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:45.975136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5db8-0a50-40b0-8d4b-780c5d3bf2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:45.993845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d49f5db8-0a50-40b0-8d4b-780c5d3bf2ec None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:20:45.995039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d49f5db8-0a50-40b0-8d4b-780c5d3bf2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:46.002952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:20:46.306541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:20:46.308389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:20:46.322159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c441a-8cf9-4ff1-90d8-ac32ebbd7881 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:20:46.325675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:20:46.326314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:20:46.326593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:20:46.326865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:20:46.336535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:20:46.338130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7012c-74d6-4b15-9eaf-297325123c77 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:20:46.347613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 768/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:20:55.988251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=11 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:20:56.343487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:27.191808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.231996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.231996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.231996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:27.231996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:27.232758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 772/1540] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:27.243135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.243745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.243745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.269414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:27.270704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:27.279878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 769/1541] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:27.284578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.295128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbd49e-bdc4-4639-b24e-ad01fc182acf None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.302892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.303594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.303871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.304147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.304893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:27.305199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.306881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.330537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 773/1542] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:27.338680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.350971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9656-1285-479d-9a77-bb81aab82fcc None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.359179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.359851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.360135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.360565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.361443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.363459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.471499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 770/1543] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:27.476077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.486866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7819e-2200-46d3-b855-5db2e1b1999a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.588772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.589919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.590453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.590968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.591910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.594089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.683225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 774/1544] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:27.686990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.703416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5004c-49e9-442a-bb6c-4018fbb03a26 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.714650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.715353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.715641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.715925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.716792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.718563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.737440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 771/1545] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:27.741714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.756066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991225e-b584-4276-bd0b-40a018c6d6a0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.766561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.767669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.768193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.768710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.769729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.771653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d545b4-8e44-45f2-935f-1bb0c2bdd285 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.788377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 775/1546] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:27.792375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:27.808712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f464da-d6c8-4865-be13-5cfd8b39654b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:27.817847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:27.818945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.819232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.819509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] PATH_INFO: `/v3/projects/7e3a8ff9ad9648d4b825437d1fcf8e5a/users/9b15d9e501344d88ab195ba16f569a3c/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.850306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3a8ff9ad9648d4b825437d1fcf8e5a, user_id=9b15d9e501344d88ab195ba16f569a3c, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:27.853287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99cf91-7976-4b42-80ff-1fb664fc1cd1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:27.930971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21731-bb97-4207-a4c2-4be5cb371e95 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.931662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21731-bb97-4207-a4c2-4be5cb371e95 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.932332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21731-bb97-4207-a4c2-4be5cb371e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:27.959732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-05c21731-bb97-4207-a4c2-4be5cb371e95 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:27.961333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-05c21731-bb97-4207-a4c2-4be5cb371e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:27.968292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 772/1547] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:27 2022] PUT /identity/v3/projects/7e3a8ff9ad9648d4b825437d1fcf8e5a/users/9b15d9e501344d88ab195ba16f569a3c/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:27.976175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053426-cc8c-4902-8d26-e13cdb1b4b61 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:27.978644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053426-cc8c-4902-8d26-e13cdb1b4b61 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:27.979252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053426-cc8c-4902-8d26-e13cdb1b4b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.013739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cf053426-cc8c-4902-8d26-e13cdb1b4b61 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.015197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cf053426-cc8c-4902-8d26-e13cdb1b4b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.048479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 776/1548] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:22:28.049930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0dcd-34ed-4c47-983a-b82b595dee33 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.050220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0dcd-34ed-4c47-983a-b82b595dee33 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.050497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0dcd-34ed-4c47-983a-b82b595dee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.101425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f53d0dcd-34ed-4c47-983a-b82b595dee33 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.102731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f53d0dcd-34ed-4c47-983a-b82b595dee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.119231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 777/1549] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.121835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae5aa-8930-4ee3-892a-34e509f9eca3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.121835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae5aa-8930-4ee3-892a-34e509f9eca3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.121835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae5aa-8930-4ee3-892a-34e509f9eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.153914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 773/1550] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.157156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16855b2-caae-49ca-9bba-3cc467606dd6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.158557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3c2ae5aa-8930-4ee3-892a-34e509f9eca3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.160135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16855b2-caae-49ca-9bba-3cc467606dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.160135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16855b2-caae-49ca-9bba-3cc467606dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.161459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3c2ae5aa-8930-4ee3-892a-34e509f9eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.180157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 778/1551] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.181617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.185817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.189294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.201643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d16855b2-caae-49ca-9bba-3cc467606dd6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.202886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d16855b2-caae-49ca-9bba-3cc467606dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.214464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 774/1552] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.216772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.217289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.218299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.221735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.222973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.240582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 779/1553] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.240800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.241918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.242465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.243670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.255596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 775/1554] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.256297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.267144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b29b74-e1f7-4aed-99ea-833b9b2db9b2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.272691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.278144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.278442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.278732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.279495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.279812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.280923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:28.280923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:22:28.280923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:22:28.281869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a91c-f4fa-4c5b-a0fc-cfdfe8f9624a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.294677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 776/1555] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.297651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bae72-3ae6-42d2-95eb-4000cea52ca6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.297651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bae72-3ae6-42d2-95eb-4000cea52ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.297651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bae72-3ae6-42d2-95eb-4000cea52ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.299042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:28.323043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017c98-e62e-4b39-8354-668659d55b14 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.324433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c47bae72-3ae6-42d2-95eb-4000cea52ca6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.325675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c47bae72-3ae6-42d2-95eb-4000cea52ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.326821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.327468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.327758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.328039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.337610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 777/1556] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.337610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966cea1-c8b5-4396-88de-fdc700094d08 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.337610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966cea1-c8b5-4396-88de-fdc700094d08 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.337610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966cea1-c8b5-4396-88de-fdc700094d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.340878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.342613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8b8ae-22f5-44a7-9f01-f08e25b99be4 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.354110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 780/1557] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:28.357051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.357349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.357666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.362573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e966cea1-c8b5-4396-88de-fdc700094d08 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.363773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e966cea1-c8b5-4396-88de-fdc700094d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.373599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 778/1558] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.378316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf4c6-40bb-4ca4-9735-3307542adabb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.378316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf4c6-40bb-4ca4-9735-3307542adabb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.378316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf4c6-40bb-4ca4-9735-3307542adabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.382413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.383849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.402250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 781/1559] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.402250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.412866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cf422-c9bf-4a62-9982-b2b9b9479d32 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.413025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-da4cf4c6-40bb-4ca4-9735-3307542adabb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.413025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-da4cf4c6-40bb-4ca4-9735-3307542adabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.413266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.413266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.413622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.413928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.414734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.415130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.416825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.420103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 779/1560] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.421122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3283-370b-4775-9f3d-63be134f1f4e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.421415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3283-370b-4775-9f3d-63be134f1f4e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.421747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3283-370b-4775-9f3d-63be134f1f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.436365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 782/1561] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.439821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.445842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-42cc3283-370b-4775-9f3d-63be134f1f4e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.447076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-42cc3283-370b-4775-9f3d-63be134f1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.456180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d36bf-23c4-4680-8f89-652cb2a5b6de admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.458203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 780/1562] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.459493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.459782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.460059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.463296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.463956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.464239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.464511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.465345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.466430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:28.466430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:22:28.466430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:22:28.467609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.478865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.480076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.491089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 781/1563] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.496464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.504642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad898cb-b906-4e8c-8e27-9224fef181ad None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.509482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.510204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.510495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.510777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.511511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.511831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.513499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135757-45ef-4806-a914-fe6c7a031bd5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.525849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 782/1564] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.527392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.527681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.527962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.547525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.552966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.558411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 783/1565] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.559222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.568874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7845eb1-592c-45bc-bb90-fe8d1c08bf48 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.574226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.574890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.575176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.575451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.576239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.576550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.578325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396c4e-478d-4233-a85f-023c1d61e255 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.589187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 783/1566] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:28.589187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.589412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:28.590591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 784/1567] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.591877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.592166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.592443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.615472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:28.616683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:28.651328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea3824-cb5e-40a5-aa00-f8f090468628 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.656213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.656874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.657783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.661967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.662916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.664958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.684737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 785/1568] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:28.684737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.697688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4ed8-b7de-41f6-8d61-64dcf9c7ac64 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.702439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.703165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.708721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.708721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.708721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.708721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.708721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.721806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 786/1569] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.725756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.734036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8667-b234-4dca-bcb0-bb0b141f3b7d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.739533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.740297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.740656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.741009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.741868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.743865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.798542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 784/1570] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/projects => generated 391 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:28.799215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.863893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 787/1571] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:28.863893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.864206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff59cec-11ad-49ab-8cf3-4080e7d8245c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.902073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:28.932214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829842-f345-41dd-95b9-3e13db542946 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.934573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.935351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.935736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.936113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.936965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:28.937538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.943703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.943703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.943703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.943703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.944175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.944285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.944285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:28.944285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:22:28.944285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:22:28.944285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:28.954579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 785/1572] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:28.955505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:28.968782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73bb0d-67c8-4032-a6c6-c1823065a0fa admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:28.975072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:28.975788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:28.976071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:28.976350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:28.977039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:28.978999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.042735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 788/1573] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.043588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.053555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a369e1-31b8-401f-acd1-d866727dcc49 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.058368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.059021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.059309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.059592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.060315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:29.060627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.062333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.074828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 789/1574] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:29.075609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.086217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be615-bdfc-43e2-8562-5c8ce261ce17 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.090787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.091424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.091712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.092133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.092768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.095345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.102474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 786/1575] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:28 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.106571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.170168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6de08b-8d94-4763-ba55-407b4f1eb5cd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.175455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.176154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.176440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.176720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.177498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.179672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.188002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 790/1576] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.193169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.214187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:29.262741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e63548-2978-442b-91c7-036a3b5004f3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.269775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.270462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.270742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.271012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.271706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.273747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.279215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 787/1577] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.279215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.288187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eef1-250e-4914-9517-28f7871799f5 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.293423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.294129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.294415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.294696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.295392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.297499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.379714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 791/1578] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.383831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.396437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95873f-4458-428b-99b8-39c35a75d370 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.401899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 788/1579] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.401899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.402189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.402663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.402946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.403222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.403955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.405621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.417262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 792/1580] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.421014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.431955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6893e-9276-4c3b-92af-d441bddeec50 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.467034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12aabf-f661-454a-9891-2bde704633c4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.473433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.474148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.474445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.474711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.475415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.477414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.497087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.497816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.498101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.498373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.499065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.501073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.551441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:29.559066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 789/1581] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.559841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.574742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 793/1582] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.580029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.586715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46eb5f-d532-4817-a970-855502b14f55 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.627863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb037a4-87a7-4a2b-b4e5-600c48ae678f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.632527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.633195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.633475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.633779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.634465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.636428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.648756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.649430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.649791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.650072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.650829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.652740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.663848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 794/1583] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.664682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.674469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da254324-798b-4194-993c-2b24fd699846 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.679494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.680138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.680425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.680705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.681429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.683074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.693523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 795/1584] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.694349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.705726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4dd4-865a-4592-9fff-88638913aaef admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.711621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.713060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.713060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.713060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.713624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.717778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.725172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:29.744995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 790/1585] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.745946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.758090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf859-41b9-4bcf-9e08-e71e16e4c953 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.762700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.763363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.763731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.764075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.764799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.766475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.778044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 791/1586] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.778963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.790188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f6be-0dcf-488d-ae70-77667f911f5e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.795132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.795876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.796229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.796575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.797264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.799749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.801884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 796/1587] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.801884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.816771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b01e74-1b93-41c8-8194-8e05aa7ecd4d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.822584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.823421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.823912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.825350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.829899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.838866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.844792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 797/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.846740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.857428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ec41a-bcd2-476e-b57c-47d912b23ae7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.863685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.864382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.864733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.864924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.865763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.867304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.879221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 798/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.880151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.892814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3401804-c18a-4cce-9627-1691c2d734a7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.899759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.900673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.901019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.901398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.902651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.904172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 792/1590] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:29 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:29.905744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.907895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.919559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4082-8e92-42b1-997f-8e03cb3f0cf0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.919763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 799/1591] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.921146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.931960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.933373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.933373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.933373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.936703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.936786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafb6b-9e38-4634-a944-298f588bbe33 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.936897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.944030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.944749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.945026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.945307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] PATH_INFO: `/v3/projects/957bc32f5d154c21acad6115599d1e2a/users/5f7f0438554d463da5b7a8aa7212b447/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.955205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 793/1592] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.955205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:29.962630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453312f6-f0ff-4492-8226-041732b367a1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:29.966374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957bc32f5d154c21acad6115599d1e2a, user_id=5f7f0438554d463da5b7a8aa7212b447, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.968797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:29.969540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:29.969960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:29.970078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.970362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:29.971610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:29.973242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:29.989925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 794/1593] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:29.991185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.002929 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6e6a-c134-4095-83d2-cc928d025221 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.009075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.010177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.010712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.011114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.012025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.014966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.029325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 795/1594] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:30.030223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.043726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cdf68-2b83-4a82-a86f-bbd2d682dd49 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.055337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.058352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.058608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 800/1595] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:29 2022] PUT /identity/v3/projects/957bc32f5d154c21acad6115599d1e2a/users/5f7f0438554d463da5b7a8aa7212b447/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.058698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.058698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] PATH_INFO: `/v3/projects/7eed65f12fce4882badd262601e7c59e/users/839cacebadc44567b6a818f762ec0f5e/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.058847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.087513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eed65f12fce4882badd262601e7c59e, user_id=839cacebadc44567b6a818f762ec0f5e, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.089253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:30.089253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:22:30.089253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:22:30.092412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.145398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b632dc-90d9-44df-ac6c-b5c288f1f507 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.150613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.151314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.151908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.152135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.152940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.154714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.167609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 801/1596] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:30.168520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.181125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0ed9-4dad-49ce-81b1-49590808300c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.187267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 796/1597] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/7eed65f12fce4882badd262601e7c59e/users/839cacebadc44567b6a818f762ec0f5e/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.190434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.252533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.253787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.254359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.254834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] PATH_INFO: `/v3/projects/69345cc29014462ba2ba4f1440d3bb00/users/dd736a7cc9ef4e8787af2edc928dee0a/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.271212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6871-fa58-41f4-939a-1e41c08cb976 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.275060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69345cc29014462ba2ba4f1440d3bb00, user_id=dd736a7cc9ef4e8787af2edc928dee0a, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.277780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.278121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8881ed-d543-4a6a-8480-f4b9a8351538 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.278667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.279048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.279425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.281374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.282296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.285256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:30.293741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 797/1598] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:30.294866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.311101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71e52-1472-4bab-8ed8-8f5867679ced admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.317278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.318126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.318512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.318924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.319831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.322356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.335456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 798/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:30.336468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.348530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168df8-9f6f-4cb4-9ad1-0b0c98226835 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.354265 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.355204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.359921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.359921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] PATH_INFO: `/v3/projects/1043044f732f4369b24ec37702a86307/users/81a240afbf154184ac453c82883c3e44/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.363277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 802/1600] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/69345cc29014462ba2ba4f1440d3bb00/users/dd736a7cc9ef4e8787af2edc928dee0a/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.368351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef2ca-8727-4391-a326-ed63d74c87f5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.368751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef2ca-8727-4391-a326-ed63d74c87f5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.369124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef2ca-8727-4391-a326-ed63d74c87f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.373514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1043044f732f4369b24ec37702a86307, user_id=81a240afbf154184ac453c82883c3e44, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.377615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.397802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:30.402065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-62eef2ca-8727-4391-a326-ed63d74c87f5 None None] MFA Rules not processed for user `5f7f0438554d463da5b7a8aa7212b447`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:30.403308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-62eef2ca-8727-4391-a326-ed63d74c87f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:30.467401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 799/1601] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/1043044f732f4369b24ec37702a86307/users/81a240afbf154184ac453c82883c3e44/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.476816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.502511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 803/1602] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:30.518759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.519754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.519754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.568920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3771a0-1583-4a92-abbf-2022bccca968 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.571101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:30.574461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:30.576278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.576278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.576278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.576278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.576915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.578444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.586143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 804/1603] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:30.586924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.593979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 800/1604] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:30.594810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.603564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ab3df-2a38-4be2-9fe8-9e20a589c86a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.611244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ecfe-31a4-4f8c-9c13-144da5665f3b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.611397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.611916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.612350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.612845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] PATH_INFO: `/v3/projects/4e576ef48dcc41f89170a17ac6c38280/users/37b9088aea984dda965c0492d0b36e3a/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.617376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.618370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.618659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.618939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] PATH_INFO: `/v3/projects/f7cc882a31a847f4adea6bd1ed687f99/users/ff9d423c21f04469af2b9fee47ad759b/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.635478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e576ef48dcc41f89170a17ac6c38280, user_id=37b9088aea984dda965c0492d0b36e3a, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.639864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc882a31a847f4adea6bd1ed687f99, user_id=ff9d423c21f04469af2b9fee47ad759b, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.640025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31044a39-cdbf-43d1-8f88-f6bb206754cc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.640562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa74b1e-86d3-4e5a-82ff-abeb72d3b571 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.736481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 801/1605] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/f7cc882a31a847f4adea6bd1ed687f99/users/ff9d423c21f04469af2b9fee47ad759b/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.742638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 805/1606] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/4e576ef48dcc41f89170a17ac6c38280/users/37b9088aea984dda965c0492d0b36e3a/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:30.744115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6f35-cb3e-4b36-ab9a-f8739160c1fd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.744507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6f35-cb3e-4b36-ab9a-f8739160c1fd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.744889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6f35-cb3e-4b36-ab9a-f8739160c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.749041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.749359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.749668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.785917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-80be6f35-cb3e-4b36-ab9a-f8739160c1fd None None] MFA Rules not processed for user `81a240afbf154184ac453c82883c3e44`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:30.787216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-80be6f35-cb3e-4b36-ab9a-f8739160c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:30.789700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:30.801676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:30.878578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 806/1607] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:30.880397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf187-4c7d-475a-9eb9-9ef96729bddb None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.880896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf187-4c7d-475a-9eb9-9ef96729bddb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.881324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf187-4c7d-475a-9eb9-9ef96729bddb None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.882932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 807/1608] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 21 09:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:30.883948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf187-4c7d-475a-9eb9-9ef96729bddb None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.889094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 802/1609] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:30.892366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:30.925658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc09328-0e71-4a0e-b12e-1788c0a8c0b2 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.925658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.925658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.925658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.926163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] PATH_INFO: `/v3/projects/2ff923a973d04f389cec531218a8b9c8/users/b2d96b4a3c5649948dac2d02bf8848f7/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.946289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff923a973d04f389cec531218a8b9c8, user_id=b2d96b4a3c5649948dac2d02bf8848f7, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.950283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508c48-4c82-444b-8704-25fe9f13ab47 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.958446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf187-4c7d-475a-9eb9-9ef96729bddb None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:30.962412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:30.963125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.963412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.963690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:30.974146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:30.975630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4fb91-14f0-47f6-9ace-b4999d95578d service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:30.990450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 808/1610] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:30.991767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:30.992068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:30.992351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.002141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:31.096980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] MFA Rules not processed for user `ff9d423c21f04469af2b9fee47ad759b`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:31.096980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:31.097522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 803/1611] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:30 2022] PUT /identity/v3/projects/2ff923a973d04f389cec531218a8b9c8/users/b2d96b4a3c5649948dac2d02bf8848f7/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:31.097522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeed5-1c47-493f-abd6-d85255ab5d43 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.097522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeed5-1c47-493f-abd6-d85255ab5d43 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.097522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfeed5-1c47-493f-abd6-d85255ab5d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.128402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:31.135573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 809/1612] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:31.136959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.139049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-88bfeed5-1c47-493f-abd6-d85255ab5d43 None None] MFA Rules not processed for user `37b9088aea984dda965c0492d0b36e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:31.140438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-88bfeed5-1c47-493f-abd6-d85255ab5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:31.169686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42206678-a957-49b8-a1f0-4f6d0f2c91fd None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.241249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 804/1613] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:31.243563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.243913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.244641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.254946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.256033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.257205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.257205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.258254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:31.261295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa086f8-237b-4117-99f0-6066478eb4a1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:31.287613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:31.289070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:31.359407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 805/1614] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:31.361133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.364483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 810/1615] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:31.365853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.366150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.366428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.384546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:31.385805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:31.430719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80bec-7b64-4150-acf2-94df000f83c0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.473511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 811/1616] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:31.474648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.516033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.517484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.517913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.518290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.551396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4e93-3cc1-404a-a2be-aff15ce05c71 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.557135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:31.558520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.559977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.560412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.560837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.563353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:31.570564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:31.584662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 806/1617] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:31.586536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.611115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d26f7-1fc4-4a25-a11b-37348d6add96 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.622146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.623021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.623412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.623758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.624979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:31.627542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:31.650078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:31.654917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:31.661424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:31.670095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 812/1618] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:31.682736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.705616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33028b-d9af-46c8-a590-14a7a246f8e4 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.721161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.721896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.722192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.724516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.725248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:31.728022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:31.754152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 807/1619] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:31.754152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.834628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 813/1620] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:31 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:31.835036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:31.856839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0863-0a30-446e-b7d5-5c8a4a6d448f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.914476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21de0c-fd23-48fd-a24a-1b4ea1792090 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:31.929339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.930191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.930576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.930972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:31.987197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:31.988968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:31.989259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:31.991060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.038457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.050533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.062727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 808/1621] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:32.064913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.162213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.163797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.187568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 814/1622] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:32.189204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.200094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:32.207758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5101fc4-c0f8-4c11-baa9-fe2ed038c7e3 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.223443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.224203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.224491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.224767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.225517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.227225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.233976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3671e88-a734-40c2-b901-b32f1e3f7587 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.249552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.250266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.250470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 815/1623] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:32.250600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.251080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.252054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.254476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.256048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.272662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0fd5f-0f73-4644-8a44-377bcb08a2bf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.287920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.294557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.294557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.294557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] PATH_INFO: `/v3/projects/d9e8fc3d140541efbef662d2260cb3d0/users/7fb58b8914e94858a1c23a7ba343e7bd/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.312250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:32.324450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e8fc3d140541efbef662d2260cb3d0, user_id=7fb58b8914e94858a1c23a7ba343e7bd, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.329482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ec19-615c-4af6-a89d-0d72024ca5cb admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.352280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 809/1624] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:32 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:32.356302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.368467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165228e-9470-4474-a713-a72403f5c4e0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.373988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.374431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.374768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.375044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.376417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.379522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.401962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 810/1625] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:22:32.403718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.424743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5966f-47ed-44b1-a786-75bfa4fa8ee7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.432875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.451162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.451552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.452057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] PATH_INFO: `/v3/projects/a5384a90152541368b70e214fa5dbff6/users/c8d0bb1297114adcbfb814af65b55529/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.452863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 816/1626] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:32 2022] PUT /identity/v3/projects/d9e8fc3d140541efbef662d2260cb3d0/users/7fb58b8914e94858a1c23a7ba343e7bd/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:22:32.454626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7d8e-001f-42b0-81e9-895611f28129 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.454934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7d8e-001f-42b0-81e9-895611f28129 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.455419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b7d8e-001f-42b0-81e9-895611f28129 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.457604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 817/1627] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 21 09:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:32.460814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b7d8e-001f-42b0-81e9-895611f28129 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.471941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5384a90152541368b70e214fa5dbff6, user_id=c8d0bb1297114adcbfb814af65b55529, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.475490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.555443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b7d8e-001f-42b0-81e9-895611f28129 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.560436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.562167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.562701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.563189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.564098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.566670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ae629-8e7d-4961-b239-8bc3c489a514 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.582578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 818/1628] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:32.582578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.582578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.582578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.603083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 811/1629] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:32 2022] PUT /identity/v3/projects/a5384a90152541368b70e214fa5dbff6/users/c8d0bb1297114adcbfb814af65b55529/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:32.606682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.614682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:32.616715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:32.704157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 819/1630] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:32.705318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.753717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ed19-e4e6-44db-92f3-057ece5b1961 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.768444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.770737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.770737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.770737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] PATH_INFO: `/v3/projects/d9e8fc3d140541efbef662d2260cb3d0/users/7fb58b8914e94858a1c23a7ba343e7bd/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.777072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e8fc3d140541efbef662d2260cb3d0, user_id=7fb58b8914e94858a1c23a7ba343e7bd, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.780995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.803080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 812/1631] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:32 2022] PUT /identity/v3/projects/d9e8fc3d140541efbef662d2260cb3d0/users/7fb58b8914e94858a1c23a7ba343e7bd/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:32.806653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:32.833895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aea51-6f18-4f5c-82f0-a3a990d1e4ef None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.931714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2105cc-97e1-4667-9e95-d87fa1dc6e5f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:32.934286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.935151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.935597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.935879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.936467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:32.937102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:32.937282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.937896 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.942890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88acff5-8d2b-41ab-9dc6-e1860f80a100 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:32.943020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.957299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 820/1632] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:32.959198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:32.959489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:32.959766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:32.992642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] MFA Rules not processed for user `7fb58b8914e94858a1c23a7ba343e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:32.995446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:33.093059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 821/1633] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:33.093059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:33.101831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd58252-7c3b-4cb0-b398-cb382c5f926f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:33.102872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:33.105539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ecd87-6133-4c8d-8ea2-04c4e9fe4f8b service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:33.106924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:33.107830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:33.108165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:33.108447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] PATH_INFO: `/v3/projects/a5384a90152541368b70e214fa5dbff6/users/c8d0bb1297114adcbfb814af65b55529/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:33.110829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5384a90152541368b70e214fa5dbff6, user_id=c8d0bb1297114adcbfb814af65b55529, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:33.113722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:33.135205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 813/1635] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:33.136304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:33.136424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 822/1635] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:33 2022] PUT /identity/v3/projects/a5384a90152541368b70e214fa5dbff6/users/c8d0bb1297114adcbfb814af65b55529/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:33.136630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:33.136894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:33.182949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] MFA Rules not processed for user `c8d0bb1297114adcbfb814af65b55529`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:33.184248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:33.265445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:33.273201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:33.346923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 814/1636] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:33.379046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d5df-0fe7-4028-bcb5-c54e7c685689 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:33.383391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:33.387248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:33.387248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:33.387248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:33.452017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:33.453551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:33.470906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 823/1637] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:22:33.586008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:33.864338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:33.864338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff1eb0-1b55-48d8-8e14-e2d5114d469c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:33.864338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:33.864338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:33.866425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:33.866425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:33.866425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:33.866425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:33.866425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 815/1638] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:34.334938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:34.345374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c6c1-f174-4713-92c1-839eeb99aae4 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:34.349809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:34.350978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:34.351470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:34.352011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:34.420835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:34.422567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6567ec7-aaab-42a4-bd26-3a5f6649f040 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:34.446004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 824/1639] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:34.583775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:34.597446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165116b-8d2d-4a62-b912-5ee3a1f85bf7 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:34.605320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:34.606179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:34.606791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:34.607203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:34.700608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:34.704943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc3cbc-1519-4635-b4b8-75cb7739b721 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:34.752123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 816/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:35.404343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942875b-4a24-43ed-a507-dc14fd7374bc None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:35.404824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942875b-4a24-43ed-a507-dc14fd7374bc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:35.405062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942875b-4a24-43ed-a507-dc14fd7374bc None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:35.406601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 825/1641] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 21 09:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:35.433368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d0fc-f873-4dae-93ba-cd85457d53cb None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:35.433868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d0fc-f873-4dae-93ba-cd85457d53cb None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:35.435269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3d0fc-f873-4dae-93ba-cd85457d53cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:35.508059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:35.560914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-96b3d0fc-f873-4dae-93ba-cd85457d53cb None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:35.576574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96b3d0fc-f873-4dae-93ba-cd85457d53cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:35.771680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:35.849500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 817/1642] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 21 09:22:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:35.856192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c52fc-4dfe-4955-9795-20e1e508251e None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:35.861338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c52fc-4dfe-4955-9795-20e1e508251e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:35.861338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c52fc-4dfe-4955-9795-20e1e508251e None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:35.861338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 826/1643] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 21 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:35.868140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c174ea-6a8c-46db-906d-4bedc2c363ef None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:35.868442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c174ea-6a8c-46db-906d-4bedc2c363ef None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:35.868726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c174ea-6a8c-46db-906d-4bedc2c363ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:35.935189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f1c174ea-6a8c-46db-906d-4bedc2c363ef None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:35.936916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f1c174ea-6a8c-46db-906d-4bedc2c363ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:35.981890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 818/1644] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:22:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:35.997774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c52fc-4dfe-4955-9795-20e1e508251e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:36.044393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c52fc-4dfe-4955-9795-20e1e508251e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:36.056723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:36.064661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:36.065939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:36.067974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:36.101744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:36.107452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:36.132638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 827/1645] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:38.989303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:38.990296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:38.990770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:39.040830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] MFA Rules not processed for user `9b15d9e501344d88ab195ba16f569a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:39.052937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:39.203440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 819/1646] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:39.220604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:39.241396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f093c-17b8-4697-b22c-a6eadfc4039e service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:39.262981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:39.263870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:39.264486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:39.264913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:39.282569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:39.286757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c155c3-fa51-4fcb-bc04-081752fec26b service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:39.325248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 828/1647] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:41.656927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:41.821976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c5f8-5c7b-4c89-8104-b6bc06456a40 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:41.831928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:41.833116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:41.833638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:41.834058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] PATH_INFO: `/v3/users/37b9088aea984dda965c0492d0b36e3a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:41.842772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b9088aea984dda965c0492d0b36e3a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:41.842772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: WARNING py.warnings [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:41.842772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: warnings.warn(msg) Jul 21 09:22:41.842772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: Jul 21 09:22:41.842772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:42.226774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b9088aea984dda965c0492d0b36e3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:42.228102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b9088aea984dda965c0492d0b36e3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:42.230252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b9088aea984dda965c0492d0b36e3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:42.268051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b9088aea984dda965c0492d0b36e3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:42.369149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b9088aea984dda965c0492d0b36e3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:42.382725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:42.420688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 820/1648] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:22:41 2022] DELETE /identity/v3/users/37b9088aea984dda965c0492d0b36e3a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:42.426245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:42.427136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:42.427558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:42.469184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:42.471258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:42.603749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 829/1649] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:42.627430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:42.629001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:42.787203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2252b-ec27-420d-93ca-50513a99fa13 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:42.796222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:42.798282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:42.801355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:42.801866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:42.822380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:42.830313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9958-2cac-4e0a-8642-ef0504be0d04 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:42.873074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 821/1650] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:43.467450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:43.473936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:43.504323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8ee49-c3d5-44f7-9918-6def878b0b46 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:43.515692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:43.516739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:43.517033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:43.517313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] PATH_INFO: `/v3/users/5f7f0438554d463da5b7a8aa7212b447` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:43.527339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7f0438554d463da5b7a8aa7212b447)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:43.527738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:43.787667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:43.827371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7f0438554d463da5b7a8aa7212b447'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:43.851750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7f0438554d463da5b7a8aa7212b447'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:43.852886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7f0438554d463da5b7a8aa7212b447'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:43.853740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7f0438554d463da5b7a8aa7212b447'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:43.864219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7f0438554d463da5b7a8aa7212b447'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:43.958485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 830/1651] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:22:43 2022] DELETE /identity/v3/users/5f7f0438554d463da5b7a8aa7212b447 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:43.962865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66248-1cbc-4f53-b7c1-05403fbcc255 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:43.963907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66248-1cbc-4f53-b7c1-05403fbcc255 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:43.964359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66248-1cbc-4f53-b7c1-05403fbcc255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:44.005435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ebc66248-1cbc-4f53-b7c1-05403fbcc255 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:44.006931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ebc66248-1cbc-4f53-b7c1-05403fbcc255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:44.148908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 822/1652] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:44.262021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:44.263812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:44.450626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501ddc4-ba2d-469e-bdec-982021442ef6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:44.456491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:44.461239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:44.461239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:44.461239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:44.498122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:44.500284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:44.527848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 831/1653] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:44.752575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8acb-06e8-4280-a51a-ab6618b4c4b3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:44.758513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8acb-06e8-4280-a51a-ab6618b4c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:44.758513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8acb-06e8-4280-a51a-ab6618b4c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:44.827268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e3db8acb-06e8-4280-a51a-ab6618b4c4b3 None None] MFA Rules not processed for user `839cacebadc44567b6a818f762ec0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:44.828535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e3db8acb-06e8-4280-a51a-ab6618b4c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:44.925399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:44.929068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:44.949928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265becf-aa07-4f85-836c-916d82cbd827 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:44.958053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:44.959270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:44.960802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:44.961908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] PATH_INFO: `/v3/projects/4e576ef48dcc41f89170a17ac6c38280` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:44.963903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e576ef48dcc41f89170a17ac6c38280)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:44.965312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: WARNING py.warnings [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 09:22:44.965312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: warnings.warn(msg) Jul 21 09:22:44.965312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: Jul 21 09:22:44.966927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:45.020751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 823/1654] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:45.031396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:45.031758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:45.032081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:45.078619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] MFA Rules not processed for user `839cacebadc44567b6a818f762ec0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:45.085747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:45.106550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 824/1655] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:22:45.134597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:45.153336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:45.171988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:45.197652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e576ef48dcc41f89170a17ac6c38280', 'request_id': 'req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:45.210639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e576ef48dcc41f89170a17ac6c38280', 'request_id': 'req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:45.316555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c511c-abe9-4ed2-85c3-7f44f5f2f29d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:45.402397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e576ef48dcc41f89170a17ac6c38280', 'request_id': 'req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:45.453177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:45.463574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:45.463574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:45.468834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] The token cache is being invalidate because project 4e576ef48dcc41f89170a17ac6c38280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:22:45.469140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:45.470393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:45.482159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:45.484654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:45.502049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 832/1656] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:22:44 2022] DELETE /identity/v3/projects/4e576ef48dcc41f89170a17ac6c38280 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:45.503683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:45.508746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:45.694538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:45.755280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c23cfe-0b97-40e8-87b6-49d9c6267ebd admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:45.758385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:45.760027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:45.773314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:45.775481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:45.783812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:45.784599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] PATH_INFO: `/v3/users/c8d0bb1297114adcbfb814af65b55529` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:45.786346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d0bb1297114adcbfb814af65b55529)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:45.788429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:45.796858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 825/1657] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:45.803349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:45.806106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:45.864211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a916a4f-21e5-4f3d-94b5-70c945846da9 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:45.884939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:45.886623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:45.887042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:45.887447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] PATH_INFO: `/v3/projects/957bc32f5d154c21acad6115599d1e2a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:45.890341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=957bc32f5d154c21acad6115599d1e2a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:45.894393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:46.148140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d0bb1297114adcbfb814af65b55529'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.166673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957bc32f5d154c21acad6115599d1e2a', 'request_id': 'req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.192971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d0bb1297114adcbfb814af65b55529'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.192971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d0bb1297114adcbfb814af65b55529'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.192971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d0bb1297114adcbfb814af65b55529'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.199166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-89337a9f-9fae-44cc-89f9-d54f689400da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d0bb1297114adcbfb814af65b55529'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.306379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957bc32f5d154c21acad6115599d1e2a', 'request_id': 'req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.326465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957bc32f5d154c21acad6115599d1e2a', 'request_id': 'req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.367497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] The token cache is being invalidate because project 957bc32f5d154c21acad6115599d1e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:22:46.368133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.368546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-378a7c4a-6171-4def-99bf-0f4f7bc13f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:46.372707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 826/1658] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:22:45 2022] DELETE /identity/v3/projects/957bc32f5d154c21acad6115599d1e2a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:46.378300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.378606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.378981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.380712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 833/1659] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:22:45 2022] DELETE /identity/v3/users/c8d0bb1297114adcbfb814af65b55529 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:46.416871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:46.418622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:46.520696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 827/1660] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:46.531085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.531929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.532429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.543826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:46.555901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:46.557532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:46.573624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:46.584756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 834/1661] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:46.590168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2227c0-55d7-418e-a242-52a24a7be34c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:46.597774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:46.598825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.599825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.600351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.603092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:46.603638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:46.606320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94636e66-d09b-415b-8f36-03cba1d0fc97 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:46.637334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:46.648218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 828/1662] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:22:46.650791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61723b-b69c-4233-b791-cb9224ecf6f4 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:46.658621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:46.660484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.661218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.662209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.667161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:46.667161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:46.745355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761808a9-0e39-4932-89ad-bb47c803d23a None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.745655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761808a9-0e39-4932-89ad-bb47c803d23a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.745930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761808a9-0e39-4932-89ad-bb47c803d23a None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.747508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 829/1663] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 21 09:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:22:46.757604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.760630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.761108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.807304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 835/1664] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:46 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:22:46.811512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:46.832149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:46.835079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:46.949906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 830/1665] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:22:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:22:46.973241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30aa9-df32-4403-86e9-2e07a4611752 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:46.993447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:46.994181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:46.994466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:46.994744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:46.995447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:46.997421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.015115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.020302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:47.041035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc4a94-401f-4e02-9cce-a756b56764a0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.053870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.058174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.058955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.059248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.073838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.075853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.087099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 831/1666] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:47.089128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 836/1667] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:46 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:47.095098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.120332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62daa5-5ba1-4b53-8b02-8b32dea5f251 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.127498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.128501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.129181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.129789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.130762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.132882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.149128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 832/1668] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:47.149888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.172054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bad11d-245c-4e29-ad9f-910889a9bafd admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.178690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.179764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.180750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.181236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.182331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.184828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c6b0-2f4d-44a2-9d70-8778d809a614 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.206319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.220730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 837/1669] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:47.221939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7cb-4ffd-432e-b42c-3ca0fee99bcf admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.229114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.230116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.230406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.230688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] PATH_INFO: `/v3/projects/6f6cfe7a0676457dbafd1e5bd027e940/users/b9c526a01276495292e33b320cf7d903/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.249365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6cfe7a0676457dbafd1e5bd027e940, user_id=b9c526a01276495292e33b320cf7d903, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.252924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.374882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 833/1670] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:47 2022] PUT /identity/v3/projects/6f6cfe7a0676457dbafd1e5bd027e940/users/b9c526a01276495292e33b320cf7d903/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:47.381083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.381803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.384776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.668511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:47.668511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:47.668511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 838/1671] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:47.670489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.670489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:47.672029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:47.676556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:47.717891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a09-4726-400b-85b6-2296e0214c7d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.732209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.733550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.733863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.734145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] PATH_INFO: `/v3/users/ff9d423c21f04469af2b9fee47ad759b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.734833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475571e-f4ab-4bb0-9e58-6baf4077da26 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:47.742087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9d423c21f04469af2b9fee47ad759b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.749531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:47.757309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:47.757309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:47.763235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:47.763822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] PATH_INFO: `/v3/projects/a5384a90152541368b70e214fa5dbff6` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:47.766654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5384a90152541368b70e214fa5dbff6)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:47.769213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:48.038254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9d423c21f04469af2b9fee47ad759b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.038464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5384a90152541368b70e214fa5dbff6', 'request_id': 'req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.041239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9d423c21f04469af2b9fee47ad759b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.042271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9d423c21f04469af2b9fee47ad759b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.049057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5384a90152541368b70e214fa5dbff6', 'request_id': 'req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.064098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9d423c21f04469af2b9fee47ad759b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.118107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5384a90152541368b70e214fa5dbff6', 'request_id': 'req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.163063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] The token cache is being invalidate because project a5384a90152541368b70e214fa5dbff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:22:48.163722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.164642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-75bfae2d-cc2f-4ed6-9ada-128fa90d64a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.167486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 839/1672] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:22:47 2022] DELETE /identity/v3/projects/a5384a90152541368b70e214fa5dbff6 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:48.169161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba553-b302-4af2-9b2d-b8fbba327044 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.169729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba553-b302-4af2-9b2d-b8fbba327044 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.170668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba553-b302-4af2-9b2d-b8fbba327044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.207577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-945ba553-b302-4af2-9b2d-b8fbba327044 None None] MFA Rules not processed for user `dd736a7cc9ef4e8787af2edc928dee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.209522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-945ba553-b302-4af2-9b2d-b8fbba327044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.218488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:48.218958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9d423c21f04469af2b9fee47ad759b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:48.265914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 834/1673] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:22:47 2022] DELETE /identity/v3/users/ff9d423c21f04469af2b9fee47ad759b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:48.273190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:48.276264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.314003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 840/1674] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.323410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5782d0-88f2-421c-a7f6-37f0eeaf9e1a None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.323810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5782d0-88f2-421c-a7f6-37f0eeaf9e1a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.324861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5782d0-88f2-421c-a7f6-37f0eeaf9e1a None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.326549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 841/1675] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 21 09:22:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:48.327905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e389-37b1-49e0-b03d-9980535e1b7f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.328720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e389-37b1-49e0-b03d-9980535e1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.329793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e389-37b1-49e0-b03d-9980535e1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.355451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c236e389-37b1-49e0-b03d-9980535e1b7f None None] MFA Rules not processed for user `839cacebadc44567b6a818f762ec0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.356680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c236e389-37b1-49e0-b03d-9980535e1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.396410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:48.414984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b85fb-956a-494e-9d23-905cf29cc9cd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:48.424304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:48.425648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.426004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.426351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.435986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.460679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 842/1676] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.462504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cdba-9a49-4f05-a03e-4f91d5900d54 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.462858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cdba-9a49-4f05-a03e-4f91d5900d54 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.463185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cdba-9a49-4f05-a03e-4f91d5900d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.535445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4ec4cdba-9a49-4f05-a03e-4f91d5900d54 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.538988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4ec4cdba-9a49-4f05-a03e-4f91d5900d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.630798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:48.633397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:48.646137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 843/1677] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.646137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb4de-cb01-44c3-8ea2-9adfcf457c90 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.646137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb4de-cb01-44c3-8ea2-9adfcf457c90 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.646137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb4de-cb01-44c3-8ea2-9adfcf457c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.663870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 835/1678] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:48.664958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:48.666460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.682392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bfdbb4de-cb01-44c3-8ea2-9adfcf457c90 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.684176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bfdbb4de-cb01-44c3-8ea2-9adfcf457c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.698894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 844/1679] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.701132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2aea-b667-404c-95b1-dd26c1ea82ed None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.701463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2aea-b667-404c-95b1-dd26c1ea82ed None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.701979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2aea-b667-404c-95b1-dd26c1ea82ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.747265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f80f2aea-b667-404c-95b1-dd26c1ea82ed None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.749709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f80f2aea-b667-404c-95b1-dd26c1ea82ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.836349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7605d-1a9f-437d-a079-502141a3f1c8 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:48.862339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:48.863027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.864093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.864447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.930468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 845/1680] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.931611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:48.931943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:48.933971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:48.954356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:48.956409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.977724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 846/1681] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:48.989098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:48.990880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:48.996077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:48.997734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.010374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 836/1682] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:49.011517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:49.013043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef6d5-b7c5-44c1-8391-98ea3d9521f8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.018189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.020252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.020252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.020252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.024777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac32a4-f4b2-4f61-889f-1447bc340ce4 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.032429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.032772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.033857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.034384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.034977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.035340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b85a5-a80f-42c8-9fcb-a66065c04e56 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.038356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:49.057773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 847/1683] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:49.059178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a14f5-fa2c-47f5-872b-025f66bdeb8c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.059556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a14f5-fa2c-47f5-872b-025f66bdeb8c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.059844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a14f5-fa2c-47f5-872b-025f66bdeb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.097869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.099764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.111471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 837/1684] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:49.112562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:49.113730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-211a14f5-fa2c-47f5-872b-025f66bdeb8c None None] MFA Rules not processed for user `b2d96b4a3c5649948dac2d02bf8848f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:49.123763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-211a14f5-fa2c-47f5-872b-025f66bdeb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:49.127485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40ebe-02b7-4550-a2c0-6605612e2125 service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.140107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.140788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.141070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.141894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.143012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:49.143290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.172219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3a2f-c79a-47ca-bfe6-dc64178b2bc4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.229428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 838/1685] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:49.235712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1255-af1f-434d-ac7a-ce33efefd938 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.239372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1255-af1f-434d-ac7a-ce33efefd938 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.239662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1255-af1f-434d-ac7a-ce33efefd938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.258282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 848/1686] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:49.259923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc220e-be66-4b08-a2ac-acca5a6fa53d None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.260221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc220e-be66-4b08-a2ac-acca5a6fa53d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.260502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc220e-be66-4b08-a2ac-acca5a6fa53d None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.265256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 849/1687] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 21 09:22:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:22:49.266163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc220e-be66-4b08-a2ac-acca5a6fa53d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:49.305684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3c2c1255-af1f-434d-ac7a-ce33efefd938 None None] MFA Rules not processed for user `9b15d9e501344d88ab195ba16f569a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:49.306404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc220e-be66-4b08-a2ac-acca5a6fa53d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.308199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3c2c1255-af1f-434d-ac7a-ce33efefd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:49.312874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.313817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.314177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.314497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.315323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.317203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781060f0-af17-4f2d-bcf0-653e7700d300 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.510995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 839/1688] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:49.510995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.510995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.510995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.522573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 850/1689] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:49.522573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.522573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.522573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.589827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] MFA Rules not processed for user `b2d96b4a3c5649948dac2d02bf8848f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:49.595512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:49.606325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:49.611847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:49.794965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 851/1690] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:49.795949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:49.834301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 840/1691] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:49.848223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:49.854958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:49.865258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517210f2-a8e8-4ba6-ae10-0c61ffcdcbaa None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.871402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.872874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.873344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.873829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.886329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.889815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:49.904754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 841/1692] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:22:49.943141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a11a9-572b-4407-b450-0b6b954484a6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:49.949157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:49.951420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:49.951720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:49.952036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:49.952743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:49.954993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:50.094360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 852/1693] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:49 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:50.099245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:50.116518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6b75-10af-4e8e-9ea4-b8a539e21ff4 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:50.131382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:50.132103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:50.132371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:50.132859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:50.133993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:50.137751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:50.145715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:50.168821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 842/1694] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:50.173514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:50.190697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51021b-8853-4e2b-8c9f-2b217435370e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:50.202115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:50.203223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:50.203769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:50.205674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:50.208455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:50.211774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6225823-9f9c-4f47-a7f6-98c31cdd7295 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:50.320738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 853/1695] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:50.325811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:50.365308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963147b-4f1b-411f-bffd-a90736f563bd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:50.392635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:50.393647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:50.393943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:50.394400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] PATH_INFO: `/v3/projects/966b26cafe904ecd96d297e3c9227f42/users/4b249b27c55d4a8eb7461b114964a27f/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:50.447273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=966b26cafe904ecd96d297e3c9227f42, user_id=4b249b27c55d4a8eb7461b114964a27f, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:50.450234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:50.633722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 843/1696] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:50 2022] PUT /identity/v3/projects/966b26cafe904ecd96d297e3c9227f42/users/4b249b27c55d4a8eb7461b114964a27f/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:50.646070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:50.646755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:50.647195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:50.729961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] MFA Rules not processed for user `4b249b27c55d4a8eb7461b114964a27f`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:50.731298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:50.814716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:50.816685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:51.066987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 854/1697] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:51.067904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:51.132069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255f48-8fba-46eb-bf44-794bb26b65ca admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:51.164615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:51.165761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:51.166048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:51.166480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] PATH_INFO: `/v3/projects/f7cc882a31a847f4adea6bd1ed687f99` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:51.174563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cc882a31a847f4adea6bd1ed687f99)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:51.176723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:51.272595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216aa4-d9ef-42b7-92bd-c427b347960b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:51.290776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:51.295927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:51.295927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:51.295927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:51.295927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:51.295927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:51.419353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cc882a31a847f4adea6bd1ed687f99', 'request_id': 'req-8e592a67-3990-406a-9293-ca9a96526352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:51.469745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 855/1698] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:51 2022] POST /identity/v3/projects => generated 375 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:51.471651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:51.480374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:51.550659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cc882a31a847f4adea6bd1ed687f99', 'request_id': 'req-8e592a67-3990-406a-9293-ca9a96526352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:51.570496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cc882a31a847f4adea6bd1ed687f99', 'request_id': 'req-8e592a67-3990-406a-9293-ca9a96526352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:51.623780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:51.632261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] The token cache is being invalidate because project f7cc882a31a847f4adea6bd1ed687f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:22:51.632559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:51.634130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:22:51.640918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 844/1699] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:22:50 2022] DELETE /identity/v3/projects/f7cc882a31a847f4adea6bd1ed687f99 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:51.644407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:51.647965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:51.695407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c67318-478b-47a9-bf78-b30d1dd98cd0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:51.714920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:51.715857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:51.716304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:51.716580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:51.718484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:51.794396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e592a67-3990-406a-9293-ca9a96526352 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:51.925190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:51.925960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537487b-3760-431f-96d3-6479a8003029 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:51.978235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 856/1700] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:51.988017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb795-cec9-43c1-bb69-03e459dabd10 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:51.988017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb795-cec9-43c1-bb69-03e459dabd10 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:51.988017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb795-cec9-43c1-bb69-03e459dabd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.048550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:52.049766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.051168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:52.051823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.052253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.053163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:52.062770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e22cb795-cec9-43c1-bb69-03e459dabd10 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:52.068312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e22cb795-cec9-43c1-bb69-03e459dabd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:52.076839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:52.149954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 857/1701] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:52.166491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.167013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.169783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.254034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:52.255292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:52.285529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 858/1702] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:52.288690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:52.305800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 845/1703] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:51 2022] POST /identity/v3/users => generated 294 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:52.309818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:52.325391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9110-8130-4720-a637-03f13c9f9e89 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:52.330962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0d8f-b4ed-4f3e-9ac1-551714a893cd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:52.343735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:52.344788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.345284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.345785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.347157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:22:52.347656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:52.352107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:52.354001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:52.354109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.354109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.354555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.355547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:52.367978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:52.383458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 859/1704] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:22:52.387884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:52.401110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 846/1705] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:22:52.402838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:52.403905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c74f-4fb8-4129-b157-f885e8275a2b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:52.415580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:52.417091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.417697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.418698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.421700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:52.427384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:52.428705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dd54-7dcb-45f8-8ab8-eb5df064133b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:52.432086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:52.444442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:52.445834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:52.446351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:52.446852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] PATH_INFO: `/v3/projects/520b9c069c3b491eab77fd6512a2b286/users/f5a110dec65e4b8da321d3fac2ac62da/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:52.474504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520b9c069c3b491eab77fd6512a2b286, user_id=f5a110dec65e4b8da321d3fac2ac62da, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:52.478410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:52.638192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 860/1706] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:52 2022] POST /identity/v3/projects => generated 355 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:52.642599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 847/1707] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:52 2022] PUT /identity/v3/projects/520b9c069c3b491eab77fd6512a2b286/users/f5a110dec65e4b8da321d3fac2ac62da/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:52.642745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:52.642864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.009801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:53.044438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532623b-d310-44bb-a8ad-5ac959aa9b53 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.074139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.080306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d4777-b311-4198-a328-afeda5225cc8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.080654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.082323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.095114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.096703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.103711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.112688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.129470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.129470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.129470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.129470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.129470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951907e-4b44-4492-8366-fab74cfd429e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.194759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 848/1708] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 555 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:53.205262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.214376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.228029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.310512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] MFA Rules not processed for user `b9c526a01276495292e33b320cf7d903`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:53.312671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:53.400576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 861/1709] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:52 2022] POST /identity/v3/users => generated 278 bytes in 761 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:53.402641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.451164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94c8f3-4902-4a94-ac7e-cb697db7d495 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.473308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 849/1710] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:53.474220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.478589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.482435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.483015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.485809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] PATH_INFO: `/v3/projects/520b9c069c3b491eab77fd6512a2b286/users/f5a110dec65e4b8da321d3fac2ac62da/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.498772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=520b9c069c3b491eab77fd6512a2b286, user_id=f5a110dec65e4b8da321d3fac2ac62da, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.503393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef89ce-a3f5-417b-8c7a-53302772e28c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.524083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19fb26-79b2-41e0-bc5a-e63e77007cfe admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.524539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.524539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.524539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.524539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.524916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.524916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.546676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 850/1711] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:53.550258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.550408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 862/1712] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:53 2022] PUT /identity/v3/projects/520b9c069c3b491eab77fd6512a2b286/users/f5a110dec65e4b8da321d3fac2ac62da/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:53.550853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:53.559722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.559722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.559959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.588628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9e9a-b6a0-4e5b-b6a1-379ac8b45cda admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.620095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] MFA Rules not processed for user `f5a110dec65e4b8da321d3fac2ac62da`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:53.621418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:53.772423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.773540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.773939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.774290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.775071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.778387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.844359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 863/1713] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:53.846922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.863380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235c671-3ecf-44b2-8d14-1b066d2873ed None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:53.871820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:53.881354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:53.881354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:53.881354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:53.881354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:53.881354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:53.908969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 864/1714] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:53.913944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:53.920191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:54.037757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 851/1715] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:53 2022] POST /identity/v3/projects => generated 405 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:54.038885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:54.075108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec6b5-aebc-4cb1-93fb-c70e407810ff admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:54.183182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f155c-60f0-4a6d-819d-f1044e0ce3b3 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:54.188979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:54.189492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:54.189810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.190082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.190365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:54.190505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.190701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.191328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] PATH_INFO: `/v3/projects/a0adf6faf844465cb905e2155d3c24e3/users/1d5fb67d49f649b19a401f449d41d3c7/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:54.198932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:54.278074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0adf6faf844465cb905e2155d3c24e3, user_id=1d5fb67d49f649b19a401f449d41d3c7, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:54.284654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186d4b-00f8-455e-87dd-1804ae844f42 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:54.293023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:54.295583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:54.331669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 865/1716] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:54.332719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:54.356696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eedf8-9cc1-4ac6-96be-420223319a5f service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:54.384828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:54.394348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.394639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.394927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:54.395639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:54.397608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:54.426507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 852/1717] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:54 2022] PUT /identity/v3/projects/a0adf6faf844465cb905e2155d3c24e3/users/1d5fb67d49f649b19a401f449d41d3c7/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:54.439075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.439384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.440032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:54.580744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 866/1718] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:54 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:54.592925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:54.619857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] MFA Rules not processed for user `1d5fb67d49f649b19a401f449d41d3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:54.628349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:54.629169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6d5d-6f58-4a41-831d-dafb05d1594d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:54.670107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:54.751916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 853/1719] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:54 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:54.762652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:54.882520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:54.883546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.884856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.888805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:54.889856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:54.897366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:54.942366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 867/1720] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:54.950495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:54.972514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ceee-2bda-42c6-8de8-0260e3784497 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:54.987156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:54.989603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:54.991720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:54.994262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] PATH_INFO: `/v3/projects/b51b8f26c826450eaf1ac79275c91826/users/469a979d3e0e4a59a0bab7d01820252f/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:55.011739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55d25a-56c6-4ae9-9674-64c67f940904 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:55.025633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51b8f26c826450eaf1ac79275c91826, user_id=469a979d3e0e4a59a0bab7d01820252f, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:55.029114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:55.030998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:55.031704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:55.032527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:55.032809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:55.034028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:55.036740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:55.123284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 868/1721] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:54 2022] PUT /identity/v3/projects/b51b8f26c826450eaf1ac79275c91826/users/469a979d3e0e4a59a0bab7d01820252f/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:55.127722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:55.234313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab26a0-f47e-418f-87ea-65b0c32de39c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:55.234457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 854/1722] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:22:54 2022] POST /identity/v3/projects => generated 355 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:55.235547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:55.327464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:55.328543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:55.329165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:55.332723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:55.334583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:55.342384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:55.378937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 869/1723] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:55.379712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:55.396520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-aa2b-488d-8716-1ff902f8a1a0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:55.417975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:55.419159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:55.419650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:55.420123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] PATH_INFO: `/v3/projects/b51b8f26c826450eaf1ac79275c91826/users/469a979d3e0e4a59a0bab7d01820252f/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:55.422820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51b8f26c826450eaf1ac79275c91826, user_id=469a979d3e0e4a59a0bab7d01820252f, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:55.426182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:55.442114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 870/1724] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:55 2022] PUT /identity/v3/projects/b51b8f26c826450eaf1ac79275c91826/users/469a979d3e0e4a59a0bab7d01820252f/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:55.455219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f156da-547d-40c9-bd9b-f63945e085ed admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:55.745840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:55.746865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:55.747228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:55.747581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:55.748421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:55.756803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:55.955736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 855/1725] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:22:55 2022] POST /identity/v3/users => generated 284 bytes in 717 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:22:55.957006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:55.996095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e72fea-0099-4668-ae74-37428781e915 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:56.013440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:56.017955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.018361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.018653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.020935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:56.022723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab169e-7c53-4079-be54-4080115c292d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:56.072981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 871/1726] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:22:56.078044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:56.100061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31632d1d-21f4-439f-a8c3-22e908230ccb admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:56.111607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:56.114927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.115318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.115717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] PATH_INFO: `/v3/projects/417298ffdcb44c599e7f880427a21fcb/users/f54910ea9e9d44d39ac6248c23061b51/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.149446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.149446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.149446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.211715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=417298ffdcb44c599e7f880427a21fcb, user_id=f54910ea9e9d44d39ac6248c23061b51, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:56.217719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:56.286119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:56.286119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:56.409533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 872/1727] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:22:56.441514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 856/1728] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:56 2022] PUT /identity/v3/projects/417298ffdcb44c599e7f880427a21fcb/users/f54910ea9e9d44d39ac6248c23061b51/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:56.445774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:56.461905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e58b1-0371-4646-9d58-13c7fd286aff None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:56.629068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:56.629777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.630209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.630791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.631955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:56.634023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f2d1-7662-4f4c-818d-f618df8ee7bd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:56.661935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 873/1729] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:22:56.670967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:56.707078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ede3d5-9548-4872-bcea-713925da7dfd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:56.739294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:56.740348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.740708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.740993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] PATH_INFO: `/v3/projects/417298ffdcb44c599e7f880427a21fcb/users/f54910ea9e9d44d39ac6248c23061b51/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.755536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=417298ffdcb44c599e7f880427a21fcb, user_id=f54910ea9e9d44d39ac6248c23061b51, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:56.759211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33002384-87b0-4b17-ac7e-4eccef1638cd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:56.786418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 857/1730] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:22:56 2022] PUT /identity/v3/projects/417298ffdcb44c599e7f880427a21fcb/users/f54910ea9e9d44d39ac6248c23061b51/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:22:56.799681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.799681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.800020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.880530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] MFA Rules not processed for user `f54910ea9e9d44d39ac6248c23061b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:56.881846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:56.896895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:56.900034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:56.900034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:56.933123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] MFA Rules not processed for user `dd736a7cc9ef4e8787af2edc928dee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:56.934746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:57.028637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 874/1731] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:56 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:57.054206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:57.067585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 858/1732] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:22:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:57.097339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:57.099958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:57.152631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22997-ee8b-436c-a082-bfff873d0255 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:57.157475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:57.159796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:57.160093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:57.160380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:57.192482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:57.194498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:57.209022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 875/1733] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:57 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:57.404052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:57.413224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff77de-4481-4292-8f2c-85bdd9baea49 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:57.419356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:57.420296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:57.420740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:57.421186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:57.508057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:57.519880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02d3e-7314-446a-b082-06f575a00787 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:57.524204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:57.530386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:57.530386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:57.530386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:57.562745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:57.568194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280703e-18c1-4923-94c4-4baacf2d1a87 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:57.637862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 859/1734] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:22:57.800976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:57.800976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:57.804671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 876/1735] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:22:58.152302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:59.084974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:59.085655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:59.085996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:59.154260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:22:59.185932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:59.385659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 860/1736] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 09:22:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:22:59.623177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:59.625039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:59.656520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971fbd7-7091-49c5-abee-669ecb4fc3ce service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:59.670539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:59.675616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:59.675616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:59.675616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:59.707233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:59.711781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f080-b187-4daa-8807-36725d0dbf0f service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:59.736966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 877/1737] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:00.739460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:00.760270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:00.775381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550385f1-45a1-4469-ba1b-d7877c6e76ac None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:00.788569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:00.789390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:00.790959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:00.791731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:01.004283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:01.010028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9f24-3183-49ac-9bc6-0d265a0c11c9 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:01.032465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 861/1738] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:01.082566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:02.004169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58404-ea7c-4aa5-8b6a-63e087c6a688 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:02.004459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58404-ea7c-4aa5-8b6a-63e087c6a688 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:02.004927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c58404-ea7c-4aa5-8b6a-63e087c6a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:02.060585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-44c58404-ea7c-4aa5-8b6a-63e087c6a688 None None] MFA Rules not processed for user `469a979d3e0e4a59a0bab7d01820252f`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:02.062099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-44c58404-ea7c-4aa5-8b6a-63e087c6a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:02.207371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 878/1739] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:02.951331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:03.183996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:04.409034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:04.591055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:05.522281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc2fc-1581-4da5-9738-fed98bdd5d5b None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:05.522281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc2fc-1581-4da5-9738-fed98bdd5d5b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:05.522281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc2fc-1581-4da5-9738-fed98bdd5d5b None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:05.522281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 862/1740] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:23:05.778321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e7b0-ff60-4832-9133-0ac461588eff None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:05.779367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e7b0-ff60-4832-9133-0ac461588eff None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:05.779789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02e7b0-ff60-4832-9133-0ac461588eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:05.839607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3c02e7b0-ff60-4832-9133-0ac461588eff None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:05.840845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3c02e7b0-ff60-4832-9133-0ac461588eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:05.956269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:06.068035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 879/1741] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:23:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:06.433242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698de-c32b-41cb-96c0-9ec372e5dc3e None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:06.433787 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698de-c32b-41cb-96c0-9ec372e5dc3e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:06.437513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698de-c32b-41cb-96c0-9ec372e5dc3e None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:06.444083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 863/1742] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:23:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:23:06.744822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b815-bef8-4c92-9890-b974f5ef65b7 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:06.745255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b815-bef8-4c92-9890-b974f5ef65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:06.745546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b815-bef8-4c92-9890-b974f5ef65b7 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:06.747710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 880/1743] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:23:06.755245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:06.756124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:06.756412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:06.809057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:06.810969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:06.878659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:06.879814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:06.880246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:06.942449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:06.945159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:06.977613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 881/1744] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:23:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:07.003520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:07.046178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 864/1745] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:23:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:07.386090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:07.386090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:07.386090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f7391-cff0-4bb4-9c07-7d35baf52b9e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:07.387673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:07.387673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:07.387673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:07.387673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:07.389746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:07.389746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:07.389746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 882/1746] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:07.390547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:07.390547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:07.450445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc3fd6-26fc-424e-987f-811e900ecf49 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:07.481615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:07.481615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:07.481615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:07.481615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:07.486570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:07.488752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6c39e-4fcf-44bd-b6d1-780a73197a3f service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:07.515482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 865/1747] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:07.623304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:07.644834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611eef5-2b48-409b-861b-9b3d4561bc02 service placement] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:07.651049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:07.651707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:07.652245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:07.652521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:07.663343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:07.664963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814517-03b5-4ca5-99a8-86ab4cdc8007 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:07.679248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 883/1748] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:09.049610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed60a4-03d9-4220-b9ec-013d2b346201 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:09.050094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed60a4-03d9-4220-b9ec-013d2b346201 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:09.050094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed60a4-03d9-4220-b9ec-013d2b346201 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:09.051884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 866/1749] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:23:09.068411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:09.069314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:09.069986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:09.121367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] MFA Rules not processed for user `edb8ce5739dd4a8db6e0f9d2449edfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:09.126112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:09.151147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 884/1750] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:23:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:09.186744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed60a4-03d9-4220-b9ec-013d2b346201 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:09.222984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed60a4-03d9-4220-b9ec-013d2b346201 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:09.239623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:09.239623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:09.239623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:09.239861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:09.284259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:09.286058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:09.316883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 867/1751] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:09.531478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:09.653543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea3fd-25b7-43f6-b947-7d1d20ac4b5f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:09.662613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:09.665803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:09.666261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:09.666806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] PATH_INFO: `/v3/users/b9c526a01276495292e33b320cf7d903` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:09.668558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c526a01276495292e33b320cf7d903)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:09.670792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:09.959663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c526a01276495292e33b320cf7d903'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:10.009478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c526a01276495292e33b320cf7d903'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:10.013182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c526a01276495292e33b320cf7d903'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:10.014505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c526a01276495292e33b320cf7d903'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:10.046463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c526a01276495292e33b320cf7d903'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:10.189131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 885/1752] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:09 2022] DELETE /identity/v3/users/b9c526a01276495292e33b320cf7d903 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:10.867513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:10.913831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bbba-fa31-4337-a20b-a8f069cc8429 service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:11.056052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:11.056951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:11.057234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:11.057529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] PATH_INFO: `/v3/projects/6f6cfe7a0676457dbafd1e5bd027e940` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:11.058909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6cfe7a0676457dbafd1e5bd027e940)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:11.060850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:11.293378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6cfe7a0676457dbafd1e5bd027e940', 'request_id': 'req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.361703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6cfe7a0676457dbafd1e5bd027e940', 'request_id': 'req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.366671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6cfe7a0676457dbafd1e5bd027e940', 'request_id': 'req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.390066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] The token cache is being invalidate because project 6f6cfe7a0676457dbafd1e5bd027e940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:11.390359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.399474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.399474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 868/1753] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:10 2022] DELETE /identity/v3/projects/6f6cfe7a0676457dbafd1e5bd027e940 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:11.400596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:11.402694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:11.429260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:11.454867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c644c-225d-46b6-a2da-522c718c88ba admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:11.647127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:11.647127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:11.647127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:11.647127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] PATH_INFO: `/v3/users/469a979d3e0e4a59a0bab7d01820252f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:11.647735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469a979d3e0e4a59a0bab7d01820252f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:11.647735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:11.899629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469a979d3e0e4a59a0bab7d01820252f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.918416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469a979d3e0e4a59a0bab7d01820252f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.919271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469a979d3e0e4a59a0bab7d01820252f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.919958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469a979d3e0e4a59a0bab7d01820252f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:11.932984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f6a8257a-4d59-4a9e-b6ff-ad17b34e5336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469a979d3e0e4a59a0bab7d01820252f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.110546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 886/1754] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:11 2022] DELETE /identity/v3/users/469a979d3e0e4a59a0bab7d01820252f => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:12.403935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:12.405501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:12.424883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7a9aa-d767-4ba1-8034-8fb1855a7a3a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:12.512923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:12.513639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:12.514042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:12.516537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] PATH_INFO: `/v3/projects/b51b8f26c826450eaf1ac79275c91826` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:12.517213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51b8f26c826450eaf1ac79275c91826)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:12.519612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:12.522073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:12.674286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51b8f26c826450eaf1ac79275c91826', 'request_id': 'req-668169de-ebb6-447a-9ca7-1820a7f46641'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.768753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51b8f26c826450eaf1ac79275c91826', 'request_id': 'req-668169de-ebb6-447a-9ca7-1820a7f46641'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.777028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51b8f26c826450eaf1ac79275c91826', 'request_id': 'req-668169de-ebb6-447a-9ca7-1820a7f46641'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.790454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] The token cache is being invalidate because project b51b8f26c826450eaf1ac79275c91826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:12.790752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.791416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-668169de-ebb6-447a-9ca7-1820a7f46641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:12.792983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 869/1755] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:12 2022] DELETE /identity/v3/projects/b51b8f26c826450eaf1ac79275c91826 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:12.799235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e72f9-890b-4231-8444-d79554394162 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:12.799867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e72f9-890b-4231-8444-d79554394162 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:12.799867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e72f9-890b-4231-8444-d79554394162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:12.818238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-208e72f9-890b-4231-8444-d79554394162 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:12.819561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-208e72f9-890b-4231-8444-d79554394162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:12.886260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 887/1756] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:12.893936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:12.894212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:12.894513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:12.914286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:12.915673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:12.928990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 870/1757] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:12.930077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e72f9-890b-4231-8444-d79554394162 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:12.942302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e72f9-890b-4231-8444-d79554394162 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:12.949384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:12.950099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:12.950421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:12.950712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:12.954650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:12.954650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:12.954650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:12.970205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 888/1758] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:12.975171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:12.987041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb821e-f3ec-4626-83ae-58401d1d40bd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:12.992017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:12.992934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:12.994015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:12.994015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:12.994262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:12.996891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:13.232934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 871/1759] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:12 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:13.233689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:13.258113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2386b75-062e-4ce8-8620-4549f1c25010 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:13.270961 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:13.334017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:13.334702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.334990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.335269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.335980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:13.337974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:13.420145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 889/1760] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:13 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:13.427821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:13.451242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2af88-c68d-409a-b237-ef62789f75b1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:13.458683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:13.458683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.458683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.458683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.459021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:13.459926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:13.475140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 872/1761] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:13.480187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:13.491712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53306-7622-4c51-ab39-e08d1edbe8bb admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:13.496534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:13.497235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.498955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.498955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.498955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:13.500716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc27cf-b600-4580-be35-ed80fe049945 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:13.511811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 890/1762] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:13.516544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:13.527269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5088c-2e84-443a-9092-67e361b5e487 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:13.532932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:13.534336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.534601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.534877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] PATH_INFO: `/v3/projects/4c68067ea5494e9b8f2e44f3f2279c85/users/01cc2b5c714346318434a82019597819/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.552258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c68067ea5494e9b8f2e44f3f2279c85, user_id=01cc2b5c714346318434a82019597819, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:13.555116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:13.637068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 873/1763] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:13 2022] PUT /identity/v3/projects/4c68067ea5494e9b8f2e44f3f2279c85/users/01cc2b5c714346318434a82019597819/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:13.649540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.649869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.650150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.684311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] MFA Rules not processed for user `01cc2b5c714346318434a82019597819`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:13.685236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:13.796617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 891/1764] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:13.801543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:13.885232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14545f7-7313-435c-88d1-dedcd2532f10 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:13.890575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:13.891982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:13.892278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:13.892563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:13.893345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:13.895331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.023799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 874/1765] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:13 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:14.027759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.039468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ae23-03ff-4b27-8140-642e0939a3a6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.110450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.111143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.111425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.111699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.112393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.114393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.257048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 892/1766] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:14 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:14.260820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.283003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb8c8-28c5-44ed-b30a-bfa9c64d63da admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.296868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.309684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.310686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.311163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.312122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.314788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.331359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 875/1767] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:14.332946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.353305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7e44-eabe-402f-9754-60a71292a7d2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.362213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.363287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.363583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.363866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] PATH_INFO: `/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed/users/a09886fe79704428ac7956a37b0f436b/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.393805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6c7499b0654c4aa8f3dcaf9569f3ed, user_id=a09886fe79704428ac7956a37b0f436b, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.403837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.518478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 893/1768] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:14 2022] PUT /identity/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed/users/a09886fe79704428ac7956a37b0f436b/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:14.531565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.563560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2f849-c127-4aa2-af2b-4165ebd0b94e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.665320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.666208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.666617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.666987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.667814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.670690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d634-55c2-4b4d-ad0d-f9004bac9ed1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.696996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 876/1769] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:14.699228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.715595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83f82-1084-414d-9335-dc964b1f7a04 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.721275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.722230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.722516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.722797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] PATH_INFO: `/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed/users/a09886fe79704428ac7956a37b0f436b/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.725370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6c7499b0654c4aa8f3dcaf9569f3ed, user_id=a09886fe79704428ac7956a37b0f436b, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.731990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:14.754047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 894/1770] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:14 2022] PUT /identity/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed/users/a09886fe79704428ac7956a37b0f436b/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:14.761472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.761472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.761472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.792754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] MFA Rules not processed for user `a09886fe79704428ac7956a37b0f436b`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:14.793982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:14.878329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 877/1771] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:14.890073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:14.904227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:14.928377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:14.976040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d6f41-9ccd-4e69-8f20-9a24523a35cc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:14.980701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:14.981442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:14.981758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:14.982039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:14.992472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:14.993957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90992-cb0a-4fef-bbf7-093025bafef3 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:15.004127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 895/1772] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:15.193547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:15.202977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6ec92-26b2-43e0-8314-aa215fca63a3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:15.206680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:15.207330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:15.207615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:15.207891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:15.266592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:15.268053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0fa6a-90cf-4ebb-a1a7-e3e377ab41e2 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:15.277741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 878/1773] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:15.412385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:21.316194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:21.316829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:21.316829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:21.322697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 896/1774] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:23:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:23:21.335837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:21.337118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:21.337777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:21.364160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:21.365690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:21.380679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:21.467409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 879/1775] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:23:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:21.496844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:21.498962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:21.518775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac775b0-f08d-46c8-b82a-a8ade083dc25 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:21.524979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:21.525683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:21.525998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:21.526316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:21.537169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:21.538841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d33ad2-c51b-4c36-b188-4cd02d2648f3 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:21.549798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 897/1776] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:22.255675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:22.258034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:22.355108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d3797-7c03-4f7d-9a61-83d34dd422bf None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:22.361012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:22.361975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:22.362255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:22.362528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] PATH_INFO: `/v3/users/4b249b27c55d4a8eb7461b114964a27f` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:22.363986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b249b27c55d4a8eb7461b114964a27f)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:22.366635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:22.588953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b249b27c55d4a8eb7461b114964a27f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:22.589861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b249b27c55d4a8eb7461b114964a27f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:22.591115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b249b27c55d4a8eb7461b114964a27f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:22.617142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b249b27c55d4a8eb7461b114964a27f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:22.699521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b249b27c55d4a8eb7461b114964a27f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:22.719598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 880/1777] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:22 2022] DELETE /identity/v3/users/4b249b27c55d4a8eb7461b114964a27f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:22.724902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:22.725848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:22.726400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:22.752367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:22.753833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:22.830901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 898/1778] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:22.840585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:22.842065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:22.896449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:22.920061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d24569-487f-4454-8541-b5ae7975c89a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:22.925733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:22.926525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:22.927308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:22.927308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:22.937014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:22.939286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:22.956123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 881/1779] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:23.470237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:23.470237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:23.478017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc8c6a-3167-44e0-a3d8-7522a96cac3e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:23.482921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:23.483911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:23.484200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:23.484594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] PATH_INFO: `/v3/projects/966b26cafe904ecd96d297e3c9227f42` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:23.486692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966b26cafe904ecd96d297e3c9227f42)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:23.488401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:23.650476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966b26cafe904ecd96d297e3c9227f42', 'request_id': 'req-4940d1d9-6f58-41ad-900b-066d043021c4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:23.663747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:23.665434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966b26cafe904ecd96d297e3c9227f42', 'request_id': 'req-4940d1d9-6f58-41ad-900b-066d043021c4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:23.784469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966b26cafe904ecd96d297e3c9227f42', 'request_id': 'req-4940d1d9-6f58-41ad-900b-066d043021c4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:23.801044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] The token cache is being invalidate because project 966b26cafe904ecd96d297e3c9227f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:23.801369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:23.802634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:23.805604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 899/1780] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:23 2022] DELETE /identity/v3/projects/966b26cafe904ecd96d297e3c9227f42 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:23.808557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:23.826904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007af3a-8cfe-4a65-b0ba-2ba3d150b154 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:23.915897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:23.916875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:23.917227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:23.917621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] PATH_INFO: `/v3/users/f5a110dec65e4b8da321d3fac2ac62da` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:23.919478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a110dec65e4b8da321d3fac2ac62da)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:23.921740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:24.187036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a110dec65e4b8da321d3fac2ac62da'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:24.187821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a110dec65e4b8da321d3fac2ac62da'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:24.188684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a110dec65e4b8da321d3fac2ac62da'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:24.195458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a110dec65e4b8da321d3fac2ac62da'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:24.349006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a110dec65e4b8da321d3fac2ac62da'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:24.380889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 882/1781] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:23 2022] DELETE /identity/v3/users/f5a110dec65e4b8da321d3fac2ac62da => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:25.040966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:25.041942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.061253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d1d9-6f58-41ad-900b-066d043021c4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:25.132628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:25.134156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.203341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:25.205815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.206328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.211635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] PATH_INFO: `/v3/projects/520b9c069c3b491eab77fd6512a2b286` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.211635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=520b9c069c3b491eab77fd6512a2b286)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:25.214381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:25.237523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:25.254446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020feebd-a517-4cfd-a881-5ce5ef94fa8d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:25.259807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:25.260704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.260979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.261435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] PATH_INFO: `/v3/users/1d5fb67d49f649b19a401f449d41d3c7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.262711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5fb67d49f649b19a401f449d41d3c7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:25.264807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:25.403140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520b9c069c3b491eab77fd6512a2b286', 'request_id': 'req-1460272a-3682-4da5-9328-4ec8f57eb94e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.410755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520b9c069c3b491eab77fd6512a2b286', 'request_id': 'req-1460272a-3682-4da5-9328-4ec8f57eb94e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.505222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520b9c069c3b491eab77fd6512a2b286', 'request_id': 'req-1460272a-3682-4da5-9328-4ec8f57eb94e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.517437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] The token cache is being invalidate because project 520b9c069c3b491eab77fd6512a2b286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:25.517789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.518519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1460272a-3682-4da5-9328-4ec8f57eb94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.521062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 900/1782] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:25 2022] DELETE /identity/v3/projects/520b9c069c3b491eab77fd6512a2b286 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:25.525903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f166-6bc7-4755-a054-d354795ff657 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.526254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f166-6bc7-4755-a054-d354795ff657 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.526696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f166-6bc7-4755-a054-d354795ff657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.552546 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4811f166-6bc7-4755-a054-d354795ff657 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:25.553995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4811f166-6bc7-4755-a054-d354795ff657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.560577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5fb67d49f649b19a401f449d41d3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.561464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5fb67d49f649b19a401f449d41d3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.562795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5fb67d49f649b19a401f449d41d3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.577986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5fb67d49f649b19a401f449d41d3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.632774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-29f8ff15-a63f-42ea-987b-57ad7fcf92da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5fb67d49f649b19a401f449d41d3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:25.649471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 901/1783] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:25.658363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 883/1784] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:25 2022] DELETE /identity/v3/users/1d5fb67d49f649b19a401f449d41d3c7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:25.660497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.666745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.667063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.667153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.667241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.667328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.681057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:25.682308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.687430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:25.689866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.707442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:25.761630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 884/1785] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:25.775843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 902/1786] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:25.780504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:25.780964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:25.783174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:25.791098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671582da-802a-4cf5-84fa-069beaacc797 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:25.796594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:25.797681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.797971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.798249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.798978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:25.799282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:25.800911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:25.818127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 885/1787] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:25.819456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:25.836059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783313-b00e-41ce-8c07-8246fc097612 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:25.841218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:25.842037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.842415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.842788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.843630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:25.846595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:25.864099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0080c-0dac-481f-9ec0-2717d164c5ba None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:25.868148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:25.869006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:25.869472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:25.870037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:25.879956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:25.881499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:25.892079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 903/1788] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:25.986922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 886/1789] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:25 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:25.993381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.006358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0cba-bbeb-47ec-821a-ec44a6889f78 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.082506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.083111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.083201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.084389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.084389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.086410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.221184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.223438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.230134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 904/1790] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:25 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:26.234034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.237089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61bc0-cf96-4762-a804-f969e411f609 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.241923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.242867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.243224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.243560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] PATH_INFO: `/v3/users/01cc2b5c714346318434a82019597819` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.244638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077358-076e-4275-b6cd-0fad9d67d291 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.244893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cc2b5c714346318434a82019597819)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.246888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.250311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.251039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.251329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.251729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.252480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.254336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.265489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 905/1791] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:26.270088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.282245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb36a32-8811-44cb-9abc-566ce7319df0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.287198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.287869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.288186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.288471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.289204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.290881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.303725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 906/1792] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:26.308115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.319504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3b86-471a-4a99-97ec-02e74d420849 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.324744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.325946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.326236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.326520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] PATH_INFO: `/v3/projects/61d515a709484d08854d3099abb81bfc/users/b65fb10cb67c4877921519a7a9c33bf5/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.344800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d515a709484d08854d3099abb81bfc, user_id=b65fb10cb67c4877921519a7a9c33bf5, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.348524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b3ecd-343a-42de-afa7-000556c8ebde admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.442622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:26.456808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cc2b5c714346318434a82019597819'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.457589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cc2b5c714346318434a82019597819'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.458276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cc2b5c714346318434a82019597819'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.465347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cc2b5c714346318434a82019597819'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.477623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 907/1793] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:26 2022] PUT /identity/v3/projects/61d515a709484d08854d3099abb81bfc/users/b65fb10cb67c4877921519a7a9c33bf5/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:26.488002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994f39-339d-413f-aa5f-cca94cf8bf81 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.488299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994f39-339d-413f-aa5f-cca94cf8bf81 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.488585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994f39-339d-413f-aa5f-cca94cf8bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.494866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:26.517906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-95994f39-339d-413f-aa5f-cca94cf8bf81 None None] MFA Rules not processed for user `b65fb10cb67c4877921519a7a9c33bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:26.519402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-95994f39-339d-413f-aa5f-cca94cf8bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.546012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cc2b5c714346318434a82019597819'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.577362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 887/1794] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:26 2022] DELETE /identity/v3/users/01cc2b5c714346318434a82019597819 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:26.580295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.582048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.618214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 908/1795] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:26.622483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.622910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.623201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.645371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:26.646940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.666437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea716-1555-4efd-b466-66a4eedf7d79 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.672689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.673600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.673968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.674255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] PATH_INFO: `/v3/projects/a0adf6faf844465cb905e2155d3c24e3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.675833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0adf6faf844465cb905e2155d3c24e3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.678425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.721979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 909/1796] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:26.722848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.726493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.739201 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb898f-6e8b-4e5a-b542-22db9011d288 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.746352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.747579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.748150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.748432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.749138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:26.752070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:26.818095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0adf6faf844465cb905e2155d3c24e3', 'request_id': 'req-fc6a9207-98f7-45fb-89d6-314760ee64ca'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.835280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 910/1797] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:26 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:26.835280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.835280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:26.914846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0adf6faf844465cb905e2155d3c24e3', 'request_id': 'req-fc6a9207-98f7-45fb-89d6-314760ee64ca'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.920208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93de0-beba-4a5a-90c7-4d454fe0a385 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:26.924402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0adf6faf844465cb905e2155d3c24e3', 'request_id': 'req-fc6a9207-98f7-45fb-89d6-314760ee64ca'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.942341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:26.943019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:26.943313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:26.943593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:26.949128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] The token cache is being invalidate because project a0adf6faf844465cb905e2155d3c24e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:26.949284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.950670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:26.952626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 888/1798] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:26 2022] DELETE /identity/v3/projects/a0adf6faf844465cb905e2155d3c24e3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:26.954632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:26.959414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:27.019194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:27.027112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.027112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.030313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a9207-98f7-45fb-89d6-314760ee64ca admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.035386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.036156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.036505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.036925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.037783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 911/1799] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:27.038229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.040695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.041219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.059576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:27.061433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072b46-3996-464e-9da9-c30bcc292259 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.069696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.069696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.070616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.070912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] PATH_INFO: `/v3/users/f54910ea9e9d44d39ac6248c23061b51` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.072209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54910ea9e9d44d39ac6248c23061b51)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.074445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.127758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 889/1800] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:26 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:27.131760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.142720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffa41b-b846-4622-b6dc-fe678ec396e2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.147300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.147970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.148253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.148530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.149264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.150889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.164903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 890/1801] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:27.166145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.176559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28992-4ea5-48c8-a681-ab05bcc2064b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.181528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.182448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.182729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.184210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] PATH_INFO: `/v3/projects/914f725f12f04684b274516a6281fdbf/users/d7e87ce4fa554db8a59131da0bd2852a/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.199945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f725f12f04684b274516a6281fdbf, user_id=d7e87ce4fa554db8a59131da0bd2852a, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.202923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.299731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54910ea9e9d44d39ac6248c23061b51'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:27.310998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 891/1802] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:27 2022] PUT /identity/v3/projects/914f725f12f04684b274516a6281fdbf/users/d7e87ce4fa554db8a59131da0bd2852a/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:27.315677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.350868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54910ea9e9d44d39ac6248c23061b51'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:27.353857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54910ea9e9d44d39ac6248c23061b51'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:27.354609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54910ea9e9d44d39ac6248c23061b51'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:27.367122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54910ea9e9d44d39ac6248c23061b51'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:27.433061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 912/1803] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:27 2022] DELETE /identity/v3/users/f54910ea9e9d44d39ac6248c23061b51 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:27.459354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad584f-ce5e-4930-8ac1-67289e31a433 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.525289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.526139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.526392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.526669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.527670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.529314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.540001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 892/1804] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:27.544286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.545766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:27.559341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321694-de0b-4bcd-9554-8fb2a16a57ea admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.572842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.580140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.580729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.581272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.582918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:27.583314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] PATH_INFO: `/v3/projects/914f725f12f04684b274516a6281fdbf/users/d7e87ce4fa554db8a59131da0bd2852a/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.587577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f725f12f04684b274516a6281fdbf, user_id=d7e87ce4fa554db8a59131da0bd2852a, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.592452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ec7e-60f1-432e-ba6c-4e70e0498b95 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.614958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a024a4-1153-42fc-8781-6df642676840 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.622437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 913/1805] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:27 2022] PUT /identity/v3/projects/914f725f12f04684b274516a6281fdbf/users/d7e87ce4fa554db8a59131da0bd2852a/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:27.633600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.633926 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.634203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.694633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] MFA Rules not processed for user `d7e87ce4fa554db8a59131da0bd2852a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:27.695967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:27.742580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.745112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.745574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.745888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] PATH_INFO: `/v3/projects/4c68067ea5494e9b8f2e44f3f2279c85` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.748220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c68067ea5494e9b8f2e44f3f2279c85)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.751199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.786620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 914/1806] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:27.797647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:27.802355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:27.803840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:27.814289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:27.877260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00df5-cb53-494c-b607-3fdeab2286d9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:27.883000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:27.883732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:27.884019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:27.884298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:27.907680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:27.908940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:27.925909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 915/1807] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:27.929726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c68067ea5494e9b8f2e44f3f2279c85', 'request_id': 'req-7be31b04-55ca-43a1-b223-c78ae7f1c640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.010305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c68067ea5494e9b8f2e44f3f2279c85', 'request_id': 'req-7be31b04-55ca-43a1-b223-c78ae7f1c640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.016611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c68067ea5494e9b8f2e44f3f2279c85', 'request_id': 'req-7be31b04-55ca-43a1-b223-c78ae7f1c640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.021086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.022686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:28.036158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] The token cache is being invalidate because project 4c68067ea5494e9b8f2e44f3f2279c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:28.036525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.037460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.040347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 893/1808] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:27 2022] DELETE /identity/v3/projects/4c68067ea5494e9b8f2e44f3f2279c85 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:28.045251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.045891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508802-6d37-4e69-bc64-a0d9f1e69264 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.048799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:28.162995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.163892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.164178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.164560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] PATH_INFO: `/v3/projects/417298ffdcb44c599e7f880427a21fcb` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.167417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417298ffdcb44c599e7f880427a21fcb)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.169395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.194108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31b04-55ca-43a1-b223-c78ae7f1c640 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.206900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.207809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.208093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.208375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] PATH_INFO: `/v3/users/a09886fe79704428ac7956a37b0f436b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.209656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09886fe79704428ac7956a37b0f436b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.217705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.346854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417298ffdcb44c599e7f880427a21fcb', 'request_id': 'req-fcbba899-849a-4f5c-a63a-13615a9242b0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.353155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417298ffdcb44c599e7f880427a21fcb', 'request_id': 'req-fcbba899-849a-4f5c-a63a-13615a9242b0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.442969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417298ffdcb44c599e7f880427a21fcb', 'request_id': 'req-fcbba899-849a-4f5c-a63a-13615a9242b0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.461936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] The token cache is being invalidate because project 417298ffdcb44c599e7f880427a21fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:28.462263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.462945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fcbba899-849a-4f5c-a63a-13615a9242b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.463076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09886fe79704428ac7956a37b0f436b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.463959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09886fe79704428ac7956a37b0f436b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.464819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09886fe79704428ac7956a37b0f436b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.465590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 916/1809] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:28 2022] DELETE /identity/v3/projects/417298ffdcb44c599e7f880427a21fcb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:28.470323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c926-81f0-4d9e-b3d6-3b372a6b4ca3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.470623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c926-81f0-4d9e-b3d6-3b372a6b4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.470909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c926-81f0-4d9e-b3d6-3b372a6b4ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.478243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09886fe79704428ac7956a37b0f436b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.492044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b381c926-81f0-4d9e-b3d6-3b372a6b4ca3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:28.493266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b381c926-81f0-4d9e-b3d6-3b372a6b4ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:28.538033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09886fe79704428ac7956a37b0f436b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.550757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:28.559290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 917/1810] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:28.561527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 894/1811] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:28 2022] DELETE /identity/v3/users/a09886fe79704428ac7956a37b0f436b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:28.568431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.568754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.569039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.590922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:28.592136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:28.656013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 918/1812] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:28.660471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.671511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba761e-baba-4db2-989f-0a699cedf469 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.676334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.677003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.677291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.677593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.678357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:28.687398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.687398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.697098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 895/1813] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:28.698403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.713215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65072-c94e-4a88-9b3c-15a3cb901fd8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.718678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.719812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.720163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.720511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.721764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.723841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.733369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.735210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:28.753199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05994-2a21-4f6e-9fbe-d172907b7f47 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.758957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.759879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.760657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.760952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] PATH_INFO: `/v3/users/b65fb10cb67c4877921519a7a9c33bf5` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.762239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65fb10cb67c4877921519a7a9c33bf5)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.764168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.871200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 919/1814] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:28 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:28.876958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:28.983376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062e46-5394-449e-92c5-b1bdddbf0da3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:28.983764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65fb10cb67c4877921519a7a9c33bf5'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.985262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65fb10cb67c4877921519a7a9c33bf5'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.986279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65fb10cb67c4877921519a7a9c33bf5'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:28.989921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:28.990608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:28.990893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:28.991168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:28.991860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:28.993831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:28.995256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65fb10cb67c4877921519a7a9c33bf5'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.081980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65fb10cb67c4877921519a7a9c33bf5'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.092116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 920/1815] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:28 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:29.092116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.094149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.105292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:29.113309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbfd3-0909-41ba-a1d8-8d71db13b16e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.119780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 896/1816] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:28 2022] DELETE /identity/v3/users/b65fb10cb67c4877921519a7a9c33bf5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:29.119780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.119780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.180804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.182298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.182599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.182864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] PATH_INFO: `/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.184682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6c7499b0654c4aa8f3dcaf9569f3ed)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.187680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.201126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957c8b-269d-41a6-85f8-5c67a627757e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.207474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.208197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.208483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.210647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.210647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.211412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99d33-2294-4354-a8aa-5f3b2e3e4873 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.227340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 897/1817] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:29.228591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.228883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.230517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.246854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:29.248050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.256871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 898/1818] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:29.261197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.272197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d942b-3f04-4b06-8900-2efb9925eb01 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.277381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.277975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.278386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.278748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.279472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.281066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.296136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 899/1819] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:29.304573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.314171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.333359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6c7499b0654c4aa8f3dcaf9569f3ed', 'request_id': 'req-be1d449a-2625-455e-8ea8-200f1dbb6bf4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.340293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6c7499b0654c4aa8f3dcaf9569f3ed', 'request_id': 'req-be1d449a-2625-455e-8ea8-200f1dbb6bf4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.385986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5195aa-3bcf-4c56-8d9b-6c9b557a9830 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.409197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6c7499b0654c4aa8f3dcaf9569f3ed', 'request_id': 'req-be1d449a-2625-455e-8ea8-200f1dbb6bf4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.425132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] The token cache is being invalidate because project 8b6c7499b0654c4aa8f3dcaf9569f3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:29.425726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.426619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:29.430489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 921/1820] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:29 2022] DELETE /identity/v3/projects/8b6c7499b0654c4aa8f3dcaf9569f3ed => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:29.432258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.435061 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.441997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.442675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.442960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.443239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.445671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.521942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d449a-2625-455e-8ea8-200f1dbb6bf4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.525937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.527435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.528420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.528793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.528939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a181d5-892d-45d4-87b5-2e44a50a5266 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.529075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] PATH_INFO: `/v3/projects/c66a0efbef2d4dbb90b21f039e1136b0/users/522efedb46b747f789f50789e45ba119/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.548955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 900/1821] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:29.550029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66a0efbef2d4dbb90b21f039e1136b0, user_id=522efedb46b747f789f50789e45ba119, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.550749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.551177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.551688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.553082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af28309-d9a4-43f6-a98c-9465bf67674c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.598828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:29.604467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.630525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 901/1822] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:29.630525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.632087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.637684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 922/1823] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:29 2022] PUT /identity/v3/projects/c66a0efbef2d4dbb90b21f039e1136b0/users/522efedb46b747f789f50789e45ba119/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:29.639002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5906-a28a-4ac5-8a06-8b2fb7147ad5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.639324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5906-a28a-4ac5-8a06-8b2fb7147ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.639558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5906-a28a-4ac5-8a06-8b2fb7147ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.674020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd3a56-dde5-4c51-9433-e2a1add827e5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.683931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b0cb5906-a28a-4ac5-8a06-8b2fb7147ad5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:29.685348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b0cb5906-a28a-4ac5-8a06-8b2fb7147ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.762090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.763019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.763297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.763565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] PATH_INFO: `/v3/users/81a240afbf154184ac453c82883c3e44` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.768470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a240afbf154184ac453c82883c3e44)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.770443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:29.838810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 923/1824] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:29.840237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.840532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.840812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.848157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:29.886083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] MFA Rules not processed for user `522efedb46b747f789f50789e45ba119`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:29.887357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:29.965665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 924/1825] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:29.965665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:29.980585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273e1a-147a-45a9-b001-2adca27b990e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:29.986870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:29.988021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:29.988410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:29.988698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:29.989759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:29.990075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:29.992043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.006882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a240afbf154184ac453c82883c3e44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.011380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a240afbf154184ac453c82883c3e44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.011510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 925/1826] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:30.011592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a240afbf154184ac453c82883c3e44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.011665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.011665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.019204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a240afbf154184ac453c82883c3e44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.033768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e9c62-03bb-4827-8ed0-c9b650a3cd02 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.039855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.040145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.040436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.040803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.041434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.043738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995c76b-fa93-42c2-a600-d334006c218d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.099521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a240afbf154184ac453c82883c3e44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.119991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 902/1827] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:29 2022] DELETE /identity/v3/users/81a240afbf154184ac453c82883c3e44 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:30.121071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.122729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.138543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 926/1828] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:30 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:30.139860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.140151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.140431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.171608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:30.174310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.209873 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e74c-075c-4fd0-9045-0f6a0d086ff9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.255905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 927/1829] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:30.260029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.273472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d1091-fa54-4205-943e-58eb3c0541f3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.279551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.280529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.280817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.281099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.281877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.283842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.287395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.288348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.288852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.289332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.290314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.292716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.395893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 928/1830] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:30 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:30.396906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.398888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.409927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:30.413752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0433bd6-5a8f-4b52-bd0c-b34bce64eb0b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.415761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 903/1831] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:30 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:30.416873 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.419374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.482277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.483518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.483659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.483878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] PATH_INFO: `/v3/projects/61d515a709484d08854d3099abb81bfc` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.485281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d515a709484d08854d3099abb81bfc)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.487010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c1e65-cf36-4b2e-bd2c-1021e7177f8f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.487236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.491049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.491587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.491913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.492204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.502363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.503821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.513906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 904/1832] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:30.514663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.524854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c1bc-e3af-4400-a60a-6329cc89412f service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.531000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.532419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.532700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.532972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.533825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.535442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.550458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 905/1833] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:30.550458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.561571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807e1e-5766-4151-a4f8-225445cfd2b2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.568042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.569363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.569949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.570233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.570927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.573665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.617187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d515a709484d08854d3099abb81bfc', 'request_id': 'req-323662d7-fbef-42bc-afaf-8842b25857d1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.623560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d515a709484d08854d3099abb81bfc', 'request_id': 'req-323662d7-fbef-42bc-afaf-8842b25857d1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.682097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 906/1834] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:30 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:30.682990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.695996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc867521-8bc4-45b9-9aaf-f119aa9890f0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.727114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d515a709484d08854d3099abb81bfc', 'request_id': 'req-323662d7-fbef-42bc-afaf-8842b25857d1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.754506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] The token cache is being invalidate because project 61d515a709484d08854d3099abb81bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:30.755033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.755711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:30.757340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 929/1835] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:30 2022] DELETE /identity/v3/projects/61d515a709484d08854d3099abb81bfc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:30.758222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.760596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.781799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.784039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.784542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.785029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] PATH_INFO: `/v3/projects/a277b15377c048b68c60a61555340bd9/users/569e7a4edf324ba7a19a6c98bed9bb44/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.824620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a277b15377c048b68c60a61555340bd9, user_id=569e7a4edf324ba7a19a6c98bed9bb44, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.830673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.862884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323662d7-fbef-42bc-afaf-8842b25857d1 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.868158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.868844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.869154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.869435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.870348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.872120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.886457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 930/1836] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:30.887332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.890401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:30.916652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177381b1-a969-4e5a-80d6-4720e81f44c2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:30.919503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:30.924735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:30.924735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:30.924735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] PATH_INFO: `/v3/users/d7e87ce4fa554db8a59131da0bd2852a` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:30.924735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e87ce4fa554db8a59131da0bd2852a)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:30.929837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:30.929931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 907/1837] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:30 2022] PUT /identity/v3/projects/a277b15377c048b68c60a61555340bd9/users/569e7a4edf324ba7a19a6c98bed9bb44/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:30.929931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:30.951088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:31.018629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:31.024015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c9ff-7011-4492-be4c-7af44faa2f92 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.029069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.029913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.030196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.030498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.031811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.032885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.043969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 908/1838] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:31.048811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.051171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.064696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236167-d332-4c6d-a1e2-e8621d3fb6cb admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.072398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.073351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.076367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.076367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.076367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.077338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.088708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 909/1839] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:31.089833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.100300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b769-0f3d-47e7-9c69-de75393ff484 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.107067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.110182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.110182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.110182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] PATH_INFO: `/v3/projects/d773ea2da3654cdf9bcd0ef9b23e98b1/users/ca325cc4a48e4a2aadd35fe0d7b4380e/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.128523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d773ea2da3654cdf9bcd0ef9b23e98b1, user_id=ca325cc4a48e4a2aadd35fe0d7b4380e, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.133838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.189977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e87ce4fa554db8a59131da0bd2852a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.204220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e87ce4fa554db8a59131da0bd2852a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.204974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e87ce4fa554db8a59131da0bd2852a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.205670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e87ce4fa554db8a59131da0bd2852a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.212767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e87ce4fa554db8a59131da0bd2852a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.314405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 910/1840] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:31 2022] PUT /identity/v3/projects/d773ea2da3654cdf9bcd0ef9b23e98b1/users/ca325cc4a48e4a2aadd35fe0d7b4380e/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:31.315814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.318343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.323834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 931/1841] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:30 2022] DELETE /identity/v3/users/d7e87ce4fa554db8a59131da0bd2852a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:31.324882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.337995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.428646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce905b-43bc-4c5f-b232-86b940c008c4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.502007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153b06a-5ee8-4af4-bfa6-ab440c29bd4e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.508764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.509706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.509994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.510274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] PATH_INFO: `/v3/projects/1043044f732f4369b24ec37702a86307` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.514298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1043044f732f4369b24ec37702a86307)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.516463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.600360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.601230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.601519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.601824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] PATH_INFO: `/v3/projects/a277b15377c048b68c60a61555340bd9/users/569e7a4edf324ba7a19a6c98bed9bb44/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.622530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a277b15377c048b68c60a61555340bd9, user_id=569e7a4edf324ba7a19a6c98bed9bb44, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.625373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84bbd-5ca9-4391-b0c6-4bfbb17487da admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.652893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 911/1842] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:31 2022] PUT /identity/v3/projects/a277b15377c048b68c60a61555340bd9/users/569e7a4edf324ba7a19a6c98bed9bb44/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:31.654259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.654550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.654828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.656790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1043044f732f4369b24ec37702a86307', 'request_id': 'req-7063234c-89be-4823-9ef6-daacd7e0896e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.671241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1043044f732f4369b24ec37702a86307', 'request_id': 'req-7063234c-89be-4823-9ef6-daacd7e0896e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.714627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] MFA Rules not processed for user `ca325cc4a48e4a2aadd35fe0d7b4380e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:31.716124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.771214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1043044f732f4369b24ec37702a86307', 'request_id': 'req-7063234c-89be-4823-9ef6-daacd7e0896e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.791266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] The token cache is being invalidate because project 1043044f732f4369b24ec37702a86307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:31.791638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.794351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7063234c-89be-4823-9ef6-daacd7e0896e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:31.799474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 932/1843] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:31 2022] DELETE /identity/v3/projects/1043044f732f4369b24ec37702a86307 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:31.801433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.801846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.802245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.860415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 912/1844] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:31.862642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.864438 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] MFA Rules not processed for user `569e7a4edf324ba7a19a6c98bed9bb44`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:31.865106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.866167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.875669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:31.965295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 933/1845] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:31.965489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639d8c-3f84-4f39-a21c-b2ef7f28e389 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.969891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:31.969891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:31.970778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:31.970778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:31.970778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:31.970778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] PATH_INFO: `/v3/users/7fb58b8914e94858a1c23a7ba343e7bd` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:31.972813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb58b8914e94858a1c23a7ba343e7bd)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:31.975901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:31.988171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbcaa5-ea48-4451-9478-055d1e95ed5a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:31.997607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.001124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.001124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.001124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.001124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.003282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.118088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 934/1846] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:31 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:32.118768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.121844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.205271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb58b8914e94858a1c23a7ba343e7bd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.207909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb58b8914e94858a1c23a7ba343e7bd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.209990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb58b8914e94858a1c23a7ba343e7bd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.228690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b959bb-0cbc-4e03-8830-bf6756d9e89a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:32.229967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb58b8914e94858a1c23a7ba343e7bd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.239242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.242948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.243254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.243542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] PATH_INFO: `/v3/projects/914f725f12f04684b274516a6281fdbf` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.245639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914f725f12f04684b274516a6281fdbf)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.248869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.304903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb58b8914e94858a1c23a7ba343e7bd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.315407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:32.338273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 913/1847] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:31 2022] DELETE /identity/v3/users/7fb58b8914e94858a1c23a7ba343e7bd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:32.338273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.339003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.407296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914f725f12f04684b274516a6281fdbf', 'request_id': 'req-8d187b21-c0e9-4958-9b85-d205c0691899'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.411040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c171-d914-4eb7-a5e6-8e1dd3137c00 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:32.419065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914f725f12f04684b274516a6281fdbf', 'request_id': 'req-8d187b21-c0e9-4958-9b85-d205c0691899'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.471195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.471718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.471972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.473258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.475973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.497884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914f725f12f04684b274516a6281fdbf', 'request_id': 'req-8d187b21-c0e9-4958-9b85-d205c0691899'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.519552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] The token cache is being invalidate because project 914f725f12f04684b274516a6281fdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:32.520342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.522536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:32.527936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 935/1848] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:32 2022] DELETE /identity/v3/projects/914f725f12f04684b274516a6281fdbf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:32.527936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.530674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.641357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.643367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5ca7-1e2f-4849-98a1-d2abb669fb7f service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.696078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 914/1849] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:32.696078 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.696293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.697323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.733143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d187b21-c0e9-4958-9b85-d205c0691899 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:32.739730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:32.741185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.756448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.757972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 915/1850] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:32.758084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.759092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.759196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.760071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.760727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.762839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.779802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a92bdd-5f08-42cb-b8f9-8bb8ee299292 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.781124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdbcf-f13e-4fa8-bd1c-5c304c0671d0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:32.789636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.789636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.789636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.789636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] PATH_INFO: `/v3/users/522efedb46b747f789f50789e45ba119` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.791199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522efedb46b747f789f50789e45ba119)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.794012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.848187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:32.890266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 936/1851] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:32 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:32.890266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b975b-af98-414c-b20a-038506c3e654 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.890266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b975b-af98-414c-b20a-038506c3e654 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.890266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b975b-af98-414c-b20a-038506c3e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.906576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:32.922490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-959b975b-af98-414c-b20a-038506c3e654 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:32.925000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-959b975b-af98-414c-b20a-038506c3e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:32.938958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 937/1852] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:32.940159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b975b-af98-414c-b20a-038506c3e654 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.956208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b975b-af98-414c-b20a-038506c3e654 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:32.961818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:32.962804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:32.962804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:32.963066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:32.963766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:32.965386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:32.980836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 938/1853] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:32.981794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:32.999713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522efedb46b747f789f50789e45ba119'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.001004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522efedb46b747f789f50789e45ba119'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.001716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522efedb46b747f789f50789e45ba119'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.010938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522efedb46b747f789f50789e45ba119'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.012300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960fa66-3ede-4c96-9a7a-e8b85034f19a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.019889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.020694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.021087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.021431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.022464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:33.022844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.024496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.038469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 939/1854] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:33.039480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.041185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.055723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b48d7-ef4c-48e6-a70a-34e42c3e9b00 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.060705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.061654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.061956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.062346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] PATH_INFO: `/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290/users/430b8c9ec8a44bceba257e730c1db76f/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.078994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e61c872eb6f40dfbdd8b879d1d4d290, user_id=430b8c9ec8a44bceba257e730c1db76f, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.082437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.103980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522efedb46b747f789f50789e45ba119'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.130156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 916/1855] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:32 2022] DELETE /identity/v3/users/522efedb46b747f789f50789e45ba119 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:33.131256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.141780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.200476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 940/1856] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:33 2022] PUT /identity/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290/users/430b8c9ec8a44bceba257e730c1db76f/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:33.200754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d774-6746-4257-8335-50698779b9f7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.201839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.204246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.268382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.269144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.269424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.269728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.270417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.272302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c443-7f51-4748-b028-0e2e53ed1270 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.277720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859daf-8811-479c-a62e-ebc9be203b75 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.282715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.283674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.283879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.284193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] PATH_INFO: `/v3/projects/d9e8fc3d140541efbef662d2260cb3d0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.285714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e8fc3d140541efbef662d2260cb3d0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.287337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.390530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 917/1857] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:33.392655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.392942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.393221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.411309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:33.412506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.429828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e8fc3d140541efbef662d2260cb3d0', 'request_id': 'req-78eb1079-a50e-4258-8a6c-91dc760b1648'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.435386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e8fc3d140541efbef662d2260cb3d0', 'request_id': 'req-78eb1079-a50e-4258-8a6c-91dc760b1648'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.473057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 918/1858] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:33.474259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.483810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05e9f-9ef0-4290-a1f8-0f973c0645c4 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.516808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e8fc3d140541efbef662d2260cb3d0', 'request_id': 'req-78eb1079-a50e-4258-8a6c-91dc760b1648'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.528770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] The token cache is being invalidate because project d9e8fc3d140541efbef662d2260cb3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:33.529369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.530019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:33.532385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 941/1859] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:33 2022] DELETE /identity/v3/projects/d9e8fc3d140541efbef662d2260cb3d0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:33.533131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.534451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.542753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.543441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.543723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.544007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.544774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.546627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.558714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 919/1860] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:33.559045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.562289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:33.563884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.609125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1079-a50e-4258-8a6c-91dc760b1648 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.615727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.616428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.616722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.616998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.617738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.622853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed24a-9f5c-4060-8533-0c906c34c6de admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.626597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab11a3-e1be-4f7d-bc73-40c1f7ec287c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.631455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.632351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.632632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.632907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.635221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.653478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.654980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f5e1-2d66-497d-b8d2-a40f9a0c8847 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.666215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 920/1861] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:33.667566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.667831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.669555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.687005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:33.688959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.692276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:33.698395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 921/1862] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:33.702383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.705449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 942/1863] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:33.705945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.706874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.707173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.707467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.724420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9946473-59ca-4039-814b-b69d4220c18a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.730430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.731478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.731766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.731872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:33.732049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] PATH_INFO: `/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290/users/430b8c9ec8a44bceba257e730c1db76f/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.733949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.735864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e61c872eb6f40dfbdd8b879d1d4d290, user_id=430b8c9ec8a44bceba257e730c1db76f, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.739275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.748973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 943/1864] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:33.750059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.754428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 922/1865] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:33 2022] PUT /identity/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290/users/430b8c9ec8a44bceba257e730c1db76f/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:33.757543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.769263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374ecd-d70b-46c4-bf4e-dddf482b8d79 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.808558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:33.837944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.839046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.839397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.839742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.840495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.841194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361774-4abf-49d2-b34f-e35455d6f20c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.842185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b149875-63da-4f9c-9b72-c07e1be31fa1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.846472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.847166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.847449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.847711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.850493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:33.850493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.850652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.856230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 944/1866] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:33.857387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.858228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.858514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.867822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 923/1867] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:33.870166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.888306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2505-bba4-4afc-81ed-4d110668fe82 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.894371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.895836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.896384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.896890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.897926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.899808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:33.909083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] MFA Rules not processed for user `430b8c9ec8a44bceba257e730c1db76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:33.911862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:33.913296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 924/1868] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:33.915792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:33.928920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2facb-1183-4e68-9cf9-e3ce2fa4a836 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:33.938286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:33.939491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:33.939989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:33.940704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:33.941847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:33.944278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.020023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 945/1869] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:34.020985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.043256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15842af5-6162-4144-b3b6-e557e0cb0c07 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.049853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.051273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.051869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.052334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] PATH_INFO: `/v3/projects/abf0a34499424c5bbafff9c07935e424/users/22080ce078cb4faaa7dc3eb94ddff7f6/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.084177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 925/1870] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:33 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:34.085122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.088290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf0a34499424c5bbafff9c07935e424, user_id=22080ce078cb4faaa7dc3eb94ddff7f6, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.091676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.092988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:34.164763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 946/1871] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:34 2022] PUT /identity/v3/projects/abf0a34499424c5bbafff9c07935e424/users/22080ce078cb4faaa7dc3eb94ddff7f6/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:34.165507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.181457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dbdf-1225-4df3-9352-dac848fc515f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.194133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:34.253580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.254501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.254854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.255239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.261514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86ee10-0612-41e2-a5d3-3bb92fb8aedc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.268571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.269556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.269873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.270150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.270979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.272939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.291767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:34.379042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.380611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e832c67-c53a-48e4-b24b-3f6e37a3c14a service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.395287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 926/1872] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:34.396655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.396951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.397233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.404011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 947/1873] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:34 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:34.404955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.416492 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f096-f194-4e5f-8133-71e59077d8fb admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.421414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.423043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.423775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.424132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.424940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.438903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.439913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] MFA Rules not processed for user `22080ce078cb4faaa7dc3eb94ddff7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:34.444260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:34.456754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 948/1874] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:34.457815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.469908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71294d-6a3d-4034-aa1b-b468a3c46125 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.477171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.478166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.478636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.479200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.480888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.483994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.503039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 949/1875] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:34.504120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.516116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ec98e-379b-4d72-a65e-2b613fc4b6ae admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.523353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.524422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.526519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.526519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] PATH_INFO: `/v3/projects/2401c663076b43c8ab458205ada69d05/users/af048765241d46f1bf68942fad87bd42/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.544566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2401c663076b43c8ab458205ada69d05, user_id=af048765241d46f1bf68942fad87bd42, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.548507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.560563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 927/1876] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:34.565889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.577539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383d2a-2fa1-448a-b1dd-a1455724e87a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.582455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.583158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.583430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.583856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.584444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.586740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.666673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 950/1877] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:34 2022] PUT /identity/v3/projects/2401c663076b43c8ab458205ada69d05/users/af048765241d46f1bf68942fad87bd42/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:34.667545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.674572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:34.696126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 928/1878] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:34 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:34.697833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.775062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbecb9c-4c80-4009-86e2-f7ac257f7a47 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.776484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8766-0ffe-4432-a18e-dac5f4557f29 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:34.783574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.784377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.784826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.785137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.787252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:34.840927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:34.841876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.842160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.842441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] PATH_INFO: `/v3/projects/c66a0efbef2d4dbb90b21f039e1136b0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.843642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66a0efbef2d4dbb90b21f039e1136b0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.845656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.852440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:34.853994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4a936-4e8c-4e2a-8f0e-727c7f0f6c90 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:34.864474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 929/1879] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:34.866499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:34.867174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:34.867802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:34.896495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] MFA Rules not processed for user `af048765241d46f1bf68942fad87bd42`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:34.897778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:34.957152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66a0efbef2d4dbb90b21f039e1136b0', 'request_id': 'req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:34.963055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66a0efbef2d4dbb90b21f039e1136b0', 'request_id': 'req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:34.964010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 930/1880] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:34.964919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:34.968320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:34.975565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ae76d-a807-4914-8aea-f921d250ee4d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.034132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.034912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.035166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.035445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.036140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.038103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.059219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66a0efbef2d4dbb90b21f039e1136b0', 'request_id': 'req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.072079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] The token cache is being invalidate because project c66a0efbef2d4dbb90b21f039e1136b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:35.072366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.073055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.074894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 951/1881] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:34 2022] DELETE /identity/v3/projects/c66a0efbef2d4dbb90b21f039e1136b0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:35.075595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.076879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.082318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:35.089816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b903bf-4d4b-4b75-b5bb-2ba41e2f24ae admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.096408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.097123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.097412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.097790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.098527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.100590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.148906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 931/1882] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:34 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:35.148906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.150639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.163588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d9eab-153e-426d-b2eb-4e04e9f8a5d4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.168599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.169483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.169802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.170209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] PATH_INFO: `/v3/users/569e7a4edf324ba7a19a6c98bed9bb44` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.171451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569e7a4edf324ba7a19a6c98bed9bb44)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.173423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.232841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 952/1883] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:35 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:35.236896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.242592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.329975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af0896-aba5-4530-83a8-67261e50212e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.335522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.336324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.337016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.337350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.338208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.340800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.370080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 953/1884] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:35.371138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.376818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569e7a4edf324ba7a19a6c98bed9bb44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.377533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569e7a4edf324ba7a19a6c98bed9bb44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.378586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569e7a4edf324ba7a19a6c98bed9bb44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.390101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a55bb6-2242-4825-9a0c-429543ce4929 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.395769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.396692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.396983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.397254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.398068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569e7a4edf324ba7a19a6c98bed9bb44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.398191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.400122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.456214 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569e7a4edf324ba7a19a6c98bed9bb44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:35.467508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 954/1885] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:35 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:35.468636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.471514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.486170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72135a5-d1c9-4873-845f-73cbc1f5cd2b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.494151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 932/1886] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:35 2022] DELETE /identity/v3/users/569e7a4edf324ba7a19a6c98bed9bb44 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:35.494360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.494360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.494360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.494360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] PATH_INFO: `/v3/projects/918cb2812b604888b832f7155c068aaf/users/b02f704976044e08a74c41e9abeba817/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.494675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.496354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:35.498231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.514885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=918cb2812b604888b832f7155c068aaf, user_id=b02f704976044e08a74c41e9abeba817, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.519324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.570542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:35.598215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ece23-d78a-49fc-aad8-76cbe421eae5 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.601971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 955/1887] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:35 2022] PUT /identity/v3/projects/918cb2812b604888b832f7155c068aaf/users/b02f704976044e08a74c41e9abeba817/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:35.604325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.686313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.687335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.687335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.688208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.689348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.690726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.695465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7dee6-9a28-4751-a935-d0e80ff4cccf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.700790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.701463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.701795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.702078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.705932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 933/1888] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:35.706406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.706406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.707091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.717366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 956/1889] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:35.721305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.721855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5670-9830-45aa-bdcc-6c866915ee38 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.727106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.728458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.728809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.729157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] PATH_INFO: `/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e/users/7eaa35b44c59411d94b50ffed9f92dfc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.736321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa8dc-fea3-4c8e-a951-981e09dc4029 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.744495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.745144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.745436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.746081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] PATH_INFO: `/v3/projects/918cb2812b604888b832f7155c068aaf/users/b02f704976044e08a74c41e9abeba817/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.749208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=918cb2812b604888b832f7155c068aaf, user_id=b02f704976044e08a74c41e9abeba817, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.749450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef0c7f3ba8b4c20b9f035b0d4ed372e, user_id=7eaa35b44c59411d94b50ffed9f92dfc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.752337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528def-86ad-465d-9d01-4d052dfe6e0b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.753029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.763260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 957/1890] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:35 2022] PUT /identity/v3/projects/918cb2812b604888b832f7155c068aaf/users/b02f704976044e08a74c41e9abeba817/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:35.775557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.775854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.776355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.805982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] MFA Rules not processed for user `b02f704976044e08a74c41e9abeba817`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:35.807345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.830943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 934/1891] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:35 2022] PUT /identity/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e/users/7eaa35b44c59411d94b50ffed9f92dfc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:35.832653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.907163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:35.921161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 958/1892] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:35.934569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.936110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.947107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1cf9-d740-429a-b3b2-970b04190a46 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:35.962521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:35.962521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:35.962521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:35.962521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:35.962871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:35.962871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:35.977657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 935/1893] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:35.977657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:35.978600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:35.983601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:36.017854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cfc7f-a8e1-420b-9342-712e9b597c1c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.026717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.027919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.028383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.028928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] PATH_INFO: `/v3/projects/a277b15377c048b68c60a61555340bd9` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.030644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a277b15377c048b68c60a61555340bd9)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.035438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.039090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0d3db-e70d-412d-b532-cbdcf611f32c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.101929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.102627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.102915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.103254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.105080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:36.164659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.166200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.175522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 959/1894] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:36.176356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.186325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cef71-6b0b-4de6-8eee-6523324f02c5 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.197748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.199464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.200278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.201039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] PATH_INFO: `/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e/users/7eaa35b44c59411d94b50ffed9f92dfc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.206137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef0c7f3ba8b4c20b9f035b0d4ed372e, user_id=7eaa35b44c59411d94b50ffed9f92dfc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.210997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a277b15377c048b68c60a61555340bd9', 'request_id': 'req-93abc7b9-2075-4e6b-815b-3c6bf5576cff'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:36.211647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb05f-fb0d-415b-91ee-2a8cf8ad204a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.228606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 960/1895] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:36 2022] PUT /identity/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e/users/7eaa35b44c59411d94b50ffed9f92dfc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:36.240824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299de60-583e-4319-824d-4804332243e6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.241140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299de60-583e-4319-824d-4804332243e6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.241429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299de60-583e-4319-824d-4804332243e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.270347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9299de60-583e-4319-824d-4804332243e6 None None] MFA Rules not processed for user `7eaa35b44c59411d94b50ffed9f92dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:36.270963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:36.271589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9299de60-583e-4319-824d-4804332243e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:36.316577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a277b15377c048b68c60a61555340bd9', 'request_id': 'req-93abc7b9-2075-4e6b-815b-3c6bf5576cff'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:36.322972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a277b15377c048b68c60a61555340bd9', 'request_id': 'req-93abc7b9-2075-4e6b-815b-3c6bf5576cff'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:36.337061 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] The token cache is being invalidate because project a277b15377c048b68c60a61555340bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:36.337401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:36.338739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93abc7b9-2075-4e6b-815b-3c6bf5576cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:36.340995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:36.347434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 936/1896] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:35 2022] DELETE /identity/v3/projects/a277b15377c048b68c60a61555340bd9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:36.349318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb209-84d8-4163-bc0b-fc3522b6b060 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.349738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb209-84d8-4163-bc0b-fc3522b6b060 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.350108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb209-84d8-4163-bc0b-fc3522b6b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.353270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 961/1897] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:36.371346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299de60-583e-4319-824d-4804332243e6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.382116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-690bb209-84d8-4163-bc0b-fc3522b6b060 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:36.383398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-690bb209-84d8-4163-bc0b-fc3522b6b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:36.432270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299de60-583e-4319-824d-4804332243e6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.435971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.436633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.436913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.437198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.440060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:36.449504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 937/1898] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:36.452140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.453667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.457692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.457991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.458277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.463623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 962/1899] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:36.476488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:36.477736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:36.486995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 938/1900] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:36.491199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.502869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959698-c921-4b56-a820-92fc9723596c service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.507628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.508322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.508609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.508886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.509640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:36.509951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.511550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.523463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 963/1901] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:36.528197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.537414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90359430-ed67-47e4-a2c1-21cc374c4a0b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.542134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.542794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.543080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.543358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.544048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.545988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.673599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 939/1902] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:36 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:36.676632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.701429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1335-0e06-4ede-a000-902db9e32bf5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.750749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:36.788741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.789662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.789960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.790242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.790950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.792919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.860540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 964/1903] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:36 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:36.865035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.871946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:36.877788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca23bb-90fd-4bf4-a7b3-f9baf17dc990 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.884755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.885325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.885650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.885930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.886856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.897018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.906551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 940/1904] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:36.908537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.929867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933651e1-a746-4ca4-994c-6329874c44ef admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.936002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.936681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.939357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.939357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.939357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.941419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29e0c-d344-4783-b81a-2ba1fb39addb admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:36.964464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 965/1905] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:36.964650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:36.974193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127327e-bf2f-45ce-a952-1f28b46c2a27 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:36.978933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:36.979815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:36.980103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:36.980402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] PATH_INFO: `/v3/projects/aa75ea91b53b4b7aa1e20f9275dd5e9c/users/36f7ca4d2a0c40a689bec5e83d6bfc0a/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:36.997037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa75ea91b53b4b7aa1e20f9275dd5e9c, user_id=36f7ca4d2a0c40a689bec5e83d6bfc0a, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:36.999849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.154705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 941/1906] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:36 2022] PUT /identity/v3/projects/aa75ea91b53b4b7aa1e20f9275dd5e9c/users/36f7ca4d2a0c40a689bec5e83d6bfc0a/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:37.165100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.165591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.165942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.200387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] MFA Rules not processed for user `36f7ca4d2a0c40a689bec5e83d6bfc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:37.201695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:37.286733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 966/1907] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:37.293685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:37.368130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbbf0d-3420-40d0-894e-df005f4f946f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:37.374472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:37.375783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.376472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.376472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.377193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:37.379213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.494956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 942/1908] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:37 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:37.499495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:37.511577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24186978-7d94-4849-b35c-8c38ace3b02b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:37.582264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:37.582974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.583258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.583535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.584234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:37.586192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.720773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 967/1909] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:37 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:37.722775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:37.736392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b986-84a0-4be9-a63a-c35ba6f0089d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:37.741988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:37.743089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.743411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.743956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.744727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:37.746638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.761119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 943/1910] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:37.765906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:37.784877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7340-a4ae-4673-8518-090b6b31ad96 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:37.798996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:37.801021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:37.801753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.802046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.802359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.803111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:37.804763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83fe8-64af-4f1b-a923-05692b541df0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.819578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 968/1911] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:37.821145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:37.832358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f0e35-5d52-44cb-b042-c3f4cbe263e3 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:37.838032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:37.839257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.839439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.839720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] PATH_INFO: `/v3/projects/b19216be9327447d8a36e95462a4b2af/users/4d5fcb42740843e3bf3971dd6de50b93/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:37.867963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19216be9327447d8a36e95462a4b2af, user_id=4d5fcb42740843e3bf3971dd6de50b93, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:37.873296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:37.934242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:37.982980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 944/1912] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:37 2022] PUT /identity/v3/projects/b19216be9327447d8a36e95462a4b2af/users/4d5fcb42740843e3bf3971dd6de50b93/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:37.995649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:37.996139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:37.996692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.063828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] MFA Rules not processed for user `4d5fcb42740843e3bf3971dd6de50b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:38.065723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:38.106825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.108581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:38.211903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 969/1913] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:38.213324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.226656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdf9c8-8b7e-450a-9899-6294ebf1b947 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.236785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.237000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.237195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.237443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] PATH_INFO: `/v3/users/af048765241d46f1bf68942fad87bd42` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.240083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af048765241d46f1bf68942fad87bd42)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.240203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939c652-b3f9-4cf9-89fc-d3d1541b8dff None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.242382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.249800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.252868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.253790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.254429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.257086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.261804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.363862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 970/1914] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:38 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:38.365252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.441919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4acdb-3b5a-4c6b-b2c3-d1f3e43ddc82 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.447950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.448468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.448752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.449129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.449816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.451824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.458320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af048765241d46f1bf68942fad87bd42'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:38.459228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af048765241d46f1bf68942fad87bd42'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:38.459962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af048765241d46f1bf68942fad87bd42'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:38.468223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af048765241d46f1bf68942fad87bd42'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:38.556874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 971/1915] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:38 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:38.560603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.562449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:38.575280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3f9dfbf1-1f39-4c27-b345-4b9eb809cb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af048765241d46f1bf68942fad87bd42'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:38.597636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec722-7c6a-4323-945d-a32616d88b00 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.603391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.604099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.604383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.604656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.605426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.607173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.621645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 972/1916] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:38.624307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.627663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 945/1917] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:38 2022] DELETE /identity/v3/users/af048765241d46f1bf68942fad87bd42 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:38.634944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.635522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.635946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.680613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773edfad-7fed-4dc7-8aa5-25d6609ca0cd admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.680842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:38.680842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:38.712542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:38.739771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.859202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.859202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.859202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] PATH_INFO: `/v3/projects/c943b097ad5e406287f8fb4d103056d7/users/dc1ce8895fa34aa08298549f70c7a2cc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.860745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 946/1918] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:38.861102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c943b097ad5e406287f8fb4d103056d7, user_id=dc1ce8895fa34aa08298549f70c7a2cc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.861102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.861263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:38.861263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:38.918576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373e178-db18-4f92-810f-6c02fff8440b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:38.922671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:38.923345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:38.923634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:38.923916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:38.933976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:38.935502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:38.946717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 947/1919] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:39.130213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 973/1920] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:38 2022] PUT /identity/v3/projects/c943b097ad5e406287f8fb4d103056d7/users/dc1ce8895fa34aa08298549f70c7a2cc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:39.130339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:39.130339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e8-1852-4c21-9d53-b5808a81f95e service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:39.154517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:39.155226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:39.155513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:39.155791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:39.156802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:39.159220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447665-bdbe-4fd8-95c0-718b34f27a57 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:39.172411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 948/1921] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:39.177838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:39.193421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e8fd8-8b70-418e-b348-cb12fac20f79 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:39.198662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:39.200221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:39.200528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:39.200879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] PATH_INFO: `/v3/projects/c943b097ad5e406287f8fb4d103056d7/users/dc1ce8895fa34aa08298549f70c7a2cc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:39.203971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c943b097ad5e406287f8fb4d103056d7, user_id=dc1ce8895fa34aa08298549f70c7a2cc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:39.319664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:39.319664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 974/1922] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:39 2022] PUT /identity/v3/projects/c943b097ad5e406287f8fb4d103056d7/users/dc1ce8895fa34aa08298549f70c7a2cc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:39.319867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:39.319867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:39.319867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:39.319867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] MFA Rules not processed for user `dc1ce8895fa34aa08298549f70c7a2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:39.319867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:39.409619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 949/1923] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:40.125283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:40.127905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:40.172498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:40.174400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:40.197906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da682820-dcbc-479d-b10b-8b8e88580955 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:40.202498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:40.204655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:40.205094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:40.205494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:40.221108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:40.227397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:40.231002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:40.254900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 975/1924] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:40.281156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2442d-a5ba-4fe9-a8f6-159832501839 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:40.290246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:40.290807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:40.291316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:40.291921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] PATH_INFO: `/v3/projects/2401c663076b43c8ab458205ada69d05` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:40.294231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2401c663076b43c8ab458205ada69d05)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:40.297758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:40.459522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2401c663076b43c8ab458205ada69d05', 'request_id': 'req-57351df7-1622-455d-bf26-56b47c1dc50c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.544171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2401c663076b43c8ab458205ada69d05', 'request_id': 'req-57351df7-1622-455d-bf26-56b47c1dc50c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.544371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:40.552150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2401c663076b43c8ab458205ada69d05', 'request_id': 'req-57351df7-1622-455d-bf26-56b47c1dc50c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.565696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] The token cache is being invalidate because project 2401c663076b43c8ab458205ada69d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:40.566244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.567119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.571862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 950/1925] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:40 2022] DELETE /identity/v3/projects/2401c663076b43c8ab458205ada69d05 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:40.576126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:40.587938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db28f-56a9-4bb8-9686-a29573fce0c2 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:40.648232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:40.649336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:40.649644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:40.649923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] PATH_INFO: `/v3/users/7eaa35b44c59411d94b50ffed9f92dfc` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:40.651185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eaa35b44c59411d94b50ffed9f92dfc)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:40.653509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:40.910726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eaa35b44c59411d94b50ffed9f92dfc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.939015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eaa35b44c59411d94b50ffed9f92dfc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.940135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eaa35b44c59411d94b50ffed9f92dfc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.940857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eaa35b44c59411d94b50ffed9f92dfc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:40.959617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8bb7ffc5-49da-4cc2-9b20-4c037faeac11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eaa35b44c59411d94b50ffed9f92dfc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:41.049382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 976/1926] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:40 2022] DELETE /identity/v3/users/7eaa35b44c59411d94b50ffed9f92dfc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:41.665034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:41.666156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:41.694029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351df7-1622-455d-bf26-56b47c1dc50c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:41.822958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:41.822958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:41.822958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:41.823311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] PATH_INFO: `/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:41.824441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef0c7f3ba8b4c20b9f035b0d4ed372e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:41.826455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.002298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef0c7f3ba8b4c20b9f035b0d4ed372e', 'request_id': 'req-8b052116-69a6-492d-8064-44328cbd8ecc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:42.161876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef0c7f3ba8b4c20b9f035b0d4ed372e', 'request_id': 'req-8b052116-69a6-492d-8064-44328cbd8ecc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:42.173112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:42.184360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef0c7f3ba8b4c20b9f035b0d4ed372e', 'request_id': 'req-8b052116-69a6-492d-8064-44328cbd8ecc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:42.197823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] The token cache is being invalidate because project aef0c7f3ba8b4c20b9f035b0d4ed372e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:42.198115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:42.198776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:42.200903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 951/1927] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:41 2022] DELETE /identity/v3/projects/aef0c7f3ba8b4c20b9f035b0d4ed372e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:42.206484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558a7e-5485-4f46-97d4-7ccfc88d7a94 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.206776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558a7e-5485-4f46-97d4-7ccfc88d7a94 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.207056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28558a7e-5485-4f46-97d4-7ccfc88d7a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.231019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-28558a7e-5485-4f46-97d4-7ccfc88d7a94 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:42.232728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-28558a7e-5485-4f46-97d4-7ccfc88d7a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:42.261190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.262744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:42.309493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 977/1928] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:42.314245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.314245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.314245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.337462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:42.342279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:42.356153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052116-69a6-492d-8064-44328cbd8ecc admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.357257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 978/1929] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:42.362972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.365513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.369173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.369173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.369173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.369173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:42.374810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffa8e-9e56-4c13-be75-9668ab0e96c7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.379904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.380651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.380942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.381230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.382004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:42.382319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.384019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.403485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 979/1930] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:42.405239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.416853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32472-1adc-4a86-adf6-647083aabb03 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.422612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.423724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.424019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.424782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.425598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.427531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.437225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.439591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.450203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 952/1931] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:42.521021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:42.569911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 980/1932] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:42 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:42.579936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.592112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f974b3-e3c7-433e-9c7a-c6e8cc8e3793 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.668003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.669301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.669761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.670354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.671647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.674802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.751260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 953/1933] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:42 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:42.755426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.765295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a704c1-9c99-40ab-a4dd-de55c5cf22fe admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.770680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.771361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.771656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.771938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.772676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.774335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.789605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 981/1934] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:42.792350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.805223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e534ce-834f-4bd0-afb1-75143ae2533d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.810219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.810897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.811312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.811591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.812388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.814538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89532643-7779-4c35-a1b4-6b46090288c7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.829610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 954/1935] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:42.833916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:42.845298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b83f-8f59-40ce-ad10-5c551e03fdfd admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:42.850179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:42.851077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:42.851368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:42.851649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] PATH_INFO: `/v3/projects/48946fafd899489e9dbbfd51836497db/users/56b44ee2b5ba4a1a999f4f76ab4a933e/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:42.866910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=48946fafd899489e9dbbfd51836497db, user_id=56b44ee2b5ba4a1a999f4f76ab4a933e, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:42.869644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:42.991737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 982/1936] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:42 2022] PUT /identity/v3/projects/48946fafd899489e9dbbfd51836497db/users/56b44ee2b5ba4a1a999f4f76ab4a933e/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:43.002184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.002457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.002742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.034881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] MFA Rules not processed for user `56b44ee2b5ba4a1a999f4f76ab4a933e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:43.036133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:43.113054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 955/1937] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:43.117554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.188562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc2e7-3bb1-4f34-8b9a-c06ff6fd20cc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.193582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.194332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.194684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.195058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.195824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.197866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.302931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 983/1938] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:43 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:43.311120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.323094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03053-dc21-4e69-8dba-ba14228b5659 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.381658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.382411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.382687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.382964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.383656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.385642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.496383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 956/1939] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:43 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:43.501942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.513459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114090-f7cc-45c9-a993-320d0d5a3ff1 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.519628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.520494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.525092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.525092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.525092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.525092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.536643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 984/1940] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:43.541049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.556902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd5a2-b3aa-4581-b07b-9ec31cc8691c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.557991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.558920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.559205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.559486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] PATH_INFO: `/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3/users/41ec80bc16e84311b14cde93788b1f47/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.579447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e264f123c2c4ba69b3a93d6c44bf5e3, user_id=41ec80bc16e84311b14cde93788b1f47, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.585376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.712908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 957/1941] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:43 2022] PUT /identity/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3/users/41ec80bc16e84311b14cde93788b1f47/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:43.718322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.730894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a97ac-0feb-4ea3-9ab0-a5bcefc96867 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.814126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.815437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.815977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.816263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.817008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.818697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9000a-0aa0-4339-acb8-b524a81774c0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.833198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 985/1942] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:43.834547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.845949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636212d-f7a7-4009-8758-28c9bc34f596 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:43.851193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:43.852366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.852654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.852983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] PATH_INFO: `/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3/users/41ec80bc16e84311b14cde93788b1f47/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.855334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e264f123c2c4ba69b3a93d6c44bf5e3, user_id=41ec80bc16e84311b14cde93788b1f47, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:43.858218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:43.870216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 958/1943] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:43 2022] PUT /identity/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3/users/41ec80bc16e84311b14cde93788b1f47/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:43.882253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:43.882547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:43.882827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:43.909111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] MFA Rules not processed for user `41ec80bc16e84311b14cde93788b1f47`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:43.910382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:43.981300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 986/1944] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:43.993642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:43.994508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:44.056765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1679a-a674-432b-8332-417e619603d9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:44.060483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:44.061177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:44.061469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:44.061821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:44.071912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:44.073381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:44.083163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 959/1945] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:44.130439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:44.140309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a21a83-2aff-4585-a748-285d17101853 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:44.144365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:44.145016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:44.145301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:44.145677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:44.198222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:44.210269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:44.210269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:44.217603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 987/1946] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:44.494023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:44.955011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:44.963487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2358e9-83a0-4bc6-9ed7-5153d429532d service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:44.967263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:44.967897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:44.968187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:44.969238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:44.971143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:45.036659 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:45.038156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24326d-395a-4195-8b03-28a1ca1d9ac9 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:45.047900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 960/1947] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:45.288413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:45.379707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:46.311300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:48.257310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:48.259340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:48.342909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd267e-03da-425d-b212-cea23a2d038e service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:48.349182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:48.350203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:48.350484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:48.350756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] PATH_INFO: `/v3/users/ca325cc4a48e4a2aadd35fe0d7b4380e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:48.352171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca325cc4a48e4a2aadd35fe0d7b4380e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:48.353982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:48.652479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca325cc4a48e4a2aadd35fe0d7b4380e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:48.680115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca325cc4a48e4a2aadd35fe0d7b4380e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:48.680115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca325cc4a48e4a2aadd35fe0d7b4380e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:48.680115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca325cc4a48e4a2aadd35fe0d7b4380e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:48.682595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca325cc4a48e4a2aadd35fe0d7b4380e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:48.758799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 988/1948] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:48 2022] DELETE /identity/v3/users/ca325cc4a48e4a2aadd35fe0d7b4380e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:48.763423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:48.763877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:48.763989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:48.783380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:48.784672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:48.829841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:48.845915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 961/1949] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:48.855919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:48.857408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:48.919734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493595-650d-40db-a7ea-c1af3029ad1b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:48.923518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:48.924183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:48.924471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:48.924818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:48.935718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:48.936459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:48.947334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 989/1950] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:49.433484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:49.435052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:49.448589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43926b0-0996-453b-9b06-0b80ad90d139 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:49.453470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:49.454356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:49.454647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:49.454924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] PATH_INFO: `/v3/projects/d773ea2da3654cdf9bcd0ef9b23e98b1` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:49.456149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d773ea2da3654cdf9bcd0ef9b23e98b1)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:49.458137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:49.552465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd773ea2da3654cdf9bcd0ef9b23e98b1', 'request_id': 'req-8ff34f66-f116-4246-a174-9b93ecf5784a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:49.629361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd773ea2da3654cdf9bcd0ef9b23e98b1', 'request_id': 'req-8ff34f66-f116-4246-a174-9b93ecf5784a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:49.638363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd773ea2da3654cdf9bcd0ef9b23e98b1', 'request_id': 'req-8ff34f66-f116-4246-a174-9b93ecf5784a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:49.650001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] The token cache is being invalidate because project d773ea2da3654cdf9bcd0ef9b23e98b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:49.650363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:49.651082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:49.653102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 962/1951] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:49 2022] DELETE /identity/v3/projects/d773ea2da3654cdf9bcd0ef9b23e98b1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:49.658869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:49.665017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:49.670124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2871497-276e-4cad-b79b-20aabd4da9f5 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:49.773908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:49.775065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:49.775410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:49.779733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] PATH_INFO: `/v3/users/430b8c9ec8a44bceba257e730c1db76f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:49.779733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=430b8c9ec8a44bceba257e730c1db76f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:49.780413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:49.999965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430b8c9ec8a44bceba257e730c1db76f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.018833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430b8c9ec8a44bceba257e730c1db76f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.019625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430b8c9ec8a44bceba257e730c1db76f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.020249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430b8c9ec8a44bceba257e730c1db76f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.047960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430b8c9ec8a44bceba257e730c1db76f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.122769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 990/1952] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:49 2022] DELETE /identity/v3/users/430b8c9ec8a44bceba257e730c1db76f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:50.217717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:50.219457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:50.281592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff34f66-f116-4246-a174-9b93ecf5784a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:50.343527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:50.344353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:50.344802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:50.345121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:50.347230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:50.400534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:50.420318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:50.421939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:50.432521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 963/1953] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:50.659891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:50.661367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:50.738502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091633c9-a70c-4501-a85c-498c3aa27aa5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:50.743293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:50.744161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:50.744446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:50.744726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] PATH_INFO: `/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:50.745950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e61c872eb6f40dfbdd8b879d1d4d290)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:50.747878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:50.780718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:50.911565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e61c872eb6f40dfbdd8b879d1d4d290', 'request_id': 'req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.920788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e61c872eb6f40dfbdd8b879d1d4d290', 'request_id': 'req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:50.931625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:50.933217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:50.948784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49157f-357f-42e7-89d2-07e9758d93c4 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.023171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.024148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.024556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.024832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] PATH_INFO: `/v3/users/56b44ee2b5ba4a1a999f4f76ab4a933e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.026339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b44ee2b5ba4a1a999f4f76ab4a933e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.028483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.082736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e61c872eb6f40dfbdd8b879d1d4d290', 'request_id': 'req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.095324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] The token cache is being invalidate because project 4e61c872eb6f40dfbdd8b879d1d4d290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:51.095617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.096290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1bb95626-8ac8-42ef-9d2d-35b6df37ede8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.097895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 991/1954] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:50 2022] DELETE /identity/v3/projects/4e61c872eb6f40dfbdd8b879d1d4d290 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:51.103647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f95f-3772-4618-aa6c-f418faabb6e3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.103647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f95f-3772-4618-aa6c-f418faabb6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.103647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549f95f-3772-4618-aa6c-f418faabb6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.122475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4549f95f-3772-4618-aa6c-f418faabb6e3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:51.123714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4549f95f-3772-4618-aa6c-f418faabb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.133886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 992/1955] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:51.142581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.142871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.143152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.164027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:51.165235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.174750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 993/1956] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:51.179126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.189433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cadd8-8831-42d5-b0ad-634ea2fdf169 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.194508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.197312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.197312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.197312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.197312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:51.197312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.198443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.211985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b44ee2b5ba4a1a999f4f76ab4a933e'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.213934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b44ee2b5ba4a1a999f4f76ab4a933e'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.213934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b44ee2b5ba4a1a999f4f76ab4a933e'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.221755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 994/1957] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:23:51.224162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.225040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b44ee2b5ba4a1a999f4f76ab4a933e'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.226430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.241054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9703b-f077-4503-9e55-7acabb741f98 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.246368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.246965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.247518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.248032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.249239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.251565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.294734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-db4d5d4f-a1c7-4a1e-bbb9-847c42ef9d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b44ee2b5ba4a1a999f4f76ab4a933e'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:51.317208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 964/1958] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:50 2022] DELETE /identity/v3/users/56b44ee2b5ba4a1a999f4f76ab4a933e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:51.321776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.321978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.322450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.356795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:51.356795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.363594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 995/1959] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:51.367898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.434161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 965/1960] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:51.443956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.445481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.449324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff9af9-15d8-4295-87e2-111d9cd90b36 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.456192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.458056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.458056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.458056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.458617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.460992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.524796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f5780-50d3-41c0-8fb2-5d2c900ada76 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.535471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:51.537577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 996/1961] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:51.543835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.555379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0350a4-865e-4ba1-8bc0-2cade7ce05a3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.562737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.563204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.563497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.563781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.564722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.566285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.585156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 997/1962] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:51.589529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.599943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.600691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.601117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.601406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.611137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8177-a569-499f-9baf-65512e7a7ab6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.614099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.616446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.619785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.620824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.621333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.621884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.623583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.627343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b379-2086-407e-9763-43302bb8caa6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.630335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 966/1963] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:51.642455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 998/1964] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:51.646638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.657827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e0b4-47d6-421a-b1f5-560977eb40a7 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.664267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.665184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.665967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.665967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] PATH_INFO: `/v3/projects/a7ec9d9fbc064d1b945ef94181b5ab1c/users/f1c12b53f7264103bd0f122f51167295/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.684146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ec9d9fbc064d1b945ef94181b5ab1c, user_id=f1c12b53f7264103bd0f122f51167295, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:51.687948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:51.757653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 967/1965] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:51 2022] PUT /identity/v3/projects/a7ec9d9fbc064d1b945ef94181b5ab1c/users/f1c12b53f7264103bd0f122f51167295/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:51.768279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.768839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.768839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.799503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] MFA Rules not processed for user `f1c12b53f7264103bd0f122f51167295`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:51.800823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:51.887518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 999/1966] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:51.893182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:51.984270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b7642-569c-472b-92bc-58647d1f7155 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:51.994023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:51.996498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:51.996942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:51.997400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:51.999269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.004246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.054151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:52.130938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 968/1967] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:51 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:52.135441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.150128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f972d-7588-4493-bf4d-b94e3dffb426 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.183577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.191242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:52.260350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.261410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.262178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.262465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.263181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.265453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.286848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53311376-13f1-4713-a1d1-3efefbd9392c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.291977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.292908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.293192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.293470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] PATH_INFO: `/v3/projects/48946fafd899489e9dbbfd51836497db` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.294909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=48946fafd899489e9dbbfd51836497db)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.297672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.432354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1000/1968] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:52 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:52.433213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.436611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:52.445309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:52.453874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380f82-ea79-4762-a5fb-36e8d4953125 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.458275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.459533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.459533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.459876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] PATH_INFO: `/v3/users/22080ce078cb4faaa7dc3eb94ddff7f6` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.461596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22080ce078cb4faaa7dc3eb94ddff7f6)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.463648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.472421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48946fafd899489e9dbbfd51836497db', 'request_id': 'req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.556476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48946fafd899489e9dbbfd51836497db', 'request_id': 'req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.563161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48946fafd899489e9dbbfd51836497db', 'request_id': 'req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.574672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] The token cache is being invalidate because project 48946fafd899489e9dbbfd51836497db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:52.574967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.575658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.577237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 969/1969] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:52 2022] DELETE /identity/v3/projects/48946fafd899489e9dbbfd51836497db => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:52.581066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.582473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:52.653422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8c797-4cc4-48e3-8faf-2c9fcf1e66fa admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.659233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.660591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.661068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.661353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.662146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.663804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.678135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 970/1970] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:52.678135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.678135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:52.690496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e312-c7d8-4b57-9b6d-f852944fa49e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.695317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.696202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.702436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.702436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] PATH_INFO: `/v3/users/41ec80bc16e84311b14cde93788b1f47` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.702436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ec80bc16e84311b14cde93788b1f47)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.702436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:52.736322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22080ce078cb4faaa7dc3eb94ddff7f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.748951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22080ce078cb4faaa7dc3eb94ddff7f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.750028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22080ce078cb4faaa7dc3eb94ddff7f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.750821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22080ce078cb4faaa7dc3eb94ddff7f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.758241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22080ce078cb4faaa7dc3eb94ddff7f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.815744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1001/1971] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:52 2022] DELETE /identity/v3/users/22080ce078cb4faaa7dc3eb94ddff7f6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:52.817334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:52.819239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:52.894583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:52.910267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5eb6-c4da-47ee-8dac-33276e404497 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:52.916404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:52.917642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:52.917914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:52.918301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] PATH_INFO: `/v3/projects/561c18c32954441b83688edec54c99e0/users/e250db0b61e144d8a41122724af427b8/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:52.919134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ec80bc16e84311b14cde93788b1f47'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.920263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ec80bc16e84311b14cde93788b1f47'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.921125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ec80bc16e84311b14cde93788b1f47'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.939607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ec80bc16e84311b14cde93788b1f47'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:52.942957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=561c18c32954441b83688edec54c99e0, user_id=e250db0b61e144d8a41122724af427b8, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:52.949704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb64f3-15c1-4b69-b5d9-e04a212e34bd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:53.071258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ec80bc16e84311b14cde93788b1f47'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:53.082058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1002/1972] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:52 2022] PUT /identity/v3/projects/561c18c32954441b83688edec54c99e0/users/e250db0b61e144d8a41122724af427b8/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:53.082058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.082058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.082058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.095554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 971/1973] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:52 2022] DELETE /identity/v3/users/41ec80bc16e84311b14cde93788b1f47 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:53.095554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:53.097036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.106575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:53.108127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.119485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:53.192853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1003/1974] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:53.203481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c2e75-3bb9-4bdf-b940-1b29793651b3 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:53.209293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:53.209712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:53.210047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.210357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.210640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.211395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:53.211519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.213087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:53.227444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 972/1975] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:53.232053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:53.245435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9b16-f4a6-455e-98d4-9e64aacaac92 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:53.253206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:53.254304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.254594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.256409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] PATH_INFO: `/v3/projects/561c18c32954441b83688edec54c99e0/users/e250db0b61e144d8a41122724af427b8/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.257711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561c18c32954441b83688edec54c99e0, user_id=e250db0b61e144d8a41122724af427b8, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:53.260711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e552712-eaee-42a5-bc19-c1e55db37199 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:53.274024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 973/1976] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:53 2022] PUT /identity/v3/projects/561c18c32954441b83688edec54c99e0/users/e250db0b61e144d8a41122724af427b8/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:53.285941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.286498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.286936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.295941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec9f1-bc53-44ed-bdaf-da8f64c0844f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:53.330326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] MFA Rules not processed for user `e250db0b61e144d8a41122724af427b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:53.331684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.392049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:53.392727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.393013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.393333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.463446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 974/1977] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:53.486634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:53.489609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.537421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:53.539569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:53.556192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1004/1978] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:53.634268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3107a-30e8-4882-b25c-725dcb6ca470 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:53.638642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:53.639015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.639298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.639573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.650813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:53.653097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8b623-c864-4bb3-940d-e773067aa757 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:53.689617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 975/1979] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:53.758054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:53.831888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:53.839973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:53.841457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:53.863671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f599254-1e34-4cb4-9e3a-fc7e800edd64 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:53.877451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:53.878427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:53.878716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:53.879056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] PATH_INFO: `/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:53.880798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e264f123c2c4ba69b3a93d6c44bf5e3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:53.884404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:54.063843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e264f123c2c4ba69b3a93d6c44bf5e3', 'request_id': 'req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.074473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e264f123c2c4ba69b3a93d6c44bf5e3', 'request_id': 'req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.170806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e264f123c2c4ba69b3a93d6c44bf5e3', 'request_id': 'req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.193678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] The token cache is being invalidate because project 9e264f123c2c4ba69b3a93d6c44bf5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:54.194027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.195232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e380fbc6-e4f2-4461-a0da-6f0d8f2a3a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.196905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1005/1980] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:53 2022] DELETE /identity/v3/projects/9e264f123c2c4ba69b3a93d6c44bf5e3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:54.206739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.207102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.207382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.226704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:54.227979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:54.327713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 976/1981] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:54.335622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.335948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.336240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.358286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:54.360111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:54.370852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1006/1982] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:23:54.376503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:54.387271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e0f12-dc02-4f74-935d-9afafdaee22e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:54.392952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:54.393674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.393975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.394349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.395077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:54.395077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:54.395077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:54.421351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 977/1983] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:23:54.422572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:54.433036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6a75-0592-48e7-8737-f723efc36027 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:54.447475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:54.448165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.448464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.448731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.449453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:54.464006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:54.586863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1007/1984] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:54 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:54.587064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:54.588202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:54.589715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:54.615654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb868-193f-4482-b230-cbc90f3f6dd3 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:54.691146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:54.692249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.692535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.692996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] PATH_INFO: `/v3/projects/abf0a34499424c5bbafff9c07935e424` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.694311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf0a34499424c5bbafff9c07935e424)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:54.696255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:54.697986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba639-afa3-4bac-bee3-0c34287c3e92 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:54.706250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:54.707239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:54.707744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:54.708243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:54.709193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:54.711617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:54.745757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:54.855647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf0a34499424c5bbafff9c07935e424', 'request_id': 'req-ed9c3b1b-733e-453e-b630-16833300176a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.890365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1008/1985] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:54 2022] POST /identity/v3/users => generated 281 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:54.895399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:54.911196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f19d65-ecdc-466e-972a-09790160e25d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:54.939243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf0a34499424c5bbafff9c07935e424', 'request_id': 'req-ed9c3b1b-733e-453e-b630-16833300176a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.947495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf0a34499424c5bbafff9c07935e424', 'request_id': 'req-ed9c3b1b-733e-453e-b630-16833300176a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.986281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] The token cache is being invalidate because project abf0a34499424c5bbafff9c07935e424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:54.986281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.986281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:54.992227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 978/1986] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:54 2022] DELETE /identity/v3/projects/abf0a34499424c5bbafff9c07935e424 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:54.996389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.000746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.024348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.025091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.025465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.025833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.026664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.028632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.049652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1009/1987] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:55.054758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.056477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.083912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b74e-3abe-4fc7-bcf3-a5c9eda98767 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.091786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.092880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.093375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.095019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.096101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.099223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.115025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3b1b-733e-453e-b630-16833300176a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.121682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.122977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.123267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.123544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] PATH_INFO: `/v3/users/b02f704976044e08a74c41e9abeba817` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.125098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1010/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:23:55.125514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02f704976044e08a74c41e9abeba817)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.128968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.130915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.151303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9bd8-4bab-4c48-ac61-b0c2495b2ef9 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.160624 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.162315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.163021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.163498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] PATH_INFO: `/v3/projects/423bffa730da4ebbb18b6f900bcc983c/users/26726244d3274749b79f5640c67a00b1/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.185811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423bffa730da4ebbb18b6f900bcc983c, user_id=26726244d3274749b79f5640c67a00b1, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.188871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ea93-f044-4737-9618-a010e59678b0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.312386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1011/1989] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:55 2022] PUT /identity/v3/projects/423bffa730da4ebbb18b6f900bcc983c/users/26726244d3274749b79f5640c67a00b1/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:55.323865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.324158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.324585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.326557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:55.356093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] MFA Rules not processed for user `26726244d3274749b79f5640c67a00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:55.357383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.407314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02f704976044e08a74c41e9abeba817'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:55.408311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02f704976044e08a74c41e9abeba817'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:55.408742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02f704976044e08a74c41e9abeba817'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:55.432617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02f704976044e08a74c41e9abeba817'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:55.454350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1012/1990] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:55.499585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02f704976044e08a74c41e9abeba817'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:55.548563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.550526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.561472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 979/1991] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:54 2022] DELETE /identity/v3/users/b02f704976044e08a74c41e9abeba817 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:55.563998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.571367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.674910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db497e-92f5-40f3-95fd-1a7cc0af1d2d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.694527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad5e2-f489-42b4-b9fa-f6ae568b2c63 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.704591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.706915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.707541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.709830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.823140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.825136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.827426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.829307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.829941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.830295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] PATH_INFO: `/v3/users/36f7ca4d2a0c40a689bec5e83d6bfc0a` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.832208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f7ca4d2a0c40a689bec5e83d6bfc0a)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.835565 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.841624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 980/1992] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:55.860792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:55.862381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:55.889721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f739e-ede6-4202-b1e9-7b8434377af4 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:55.899168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:55.900967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:55.901765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:55.902531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] PATH_INFO: `/v3/users/26726244d3274749b79f5640c67a00b1` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:55.905980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26726244d3274749b79f5640c67a00b1)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:55.909481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:55.935644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:56.027151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f7ca4d2a0c40a689bec5e83d6bfc0a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.045974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f7ca4d2a0c40a689bec5e83d6bfc0a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.047239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f7ca4d2a0c40a689bec5e83d6bfc0a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.048693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f7ca4d2a0c40a689bec5e83d6bfc0a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.069444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-98e24712-c9b9-4f5c-9fc7-fae803214538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f7ca4d2a0c40a689bec5e83d6bfc0a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.154741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1013/1993] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:55 2022] DELETE /identity/v3/users/36f7ca4d2a0c40a689bec5e83d6bfc0a => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:23:56.165779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.166156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.166884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.202074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:56.205488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.253974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26726244d3274749b79f5640c67a00b1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.254904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26726244d3274749b79f5640c67a00b1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.256927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26726244d3274749b79f5640c67a00b1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.271314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:56.279437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26726244d3274749b79f5640c67a00b1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.347596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26726244d3274749b79f5640c67a00b1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.364801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1014/1994] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:56.366204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.374356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.386684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 981/1995] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:55 2022] DELETE /identity/v3/users/26726244d3274749b79f5640c67a00b1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:56.387743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.389288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.399988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f669-4ee1-49ab-9cc6-750f8a43ab7b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.506169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642953b-a785-45b7-81a5-fdb556bc52f7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.506169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.507008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.507008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.507008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.509610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.510502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.510787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.511093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] PATH_INFO: `/v3/projects/918cb2812b604888b832f7155c068aaf` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.512375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=918cb2812b604888b832f7155c068aaf)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.514818 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:56.522307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.522889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:56.523904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9516e-d77c-41d2-b3c2-1fde825b9ac7 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:56.535310 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 982/1996] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:56.536672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.536973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.537256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.560270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:56.561927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.573836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 983/1997] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:56.586696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.601211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747243-c5b2-4da0-9401-63f11d68eb99 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.604218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.604801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.605088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.605367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.615657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.617170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:56.629904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 984/1998] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:23:56.629904 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.634972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.649821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24062-33b1-43bf-9478-f78f7c5b6c68 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.650941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918cb2812b604888b832f7155c068aaf', 'request_id': 'req-890330de-92ba-44a3-830c-4cc48759c9cc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.660581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918cb2812b604888b832f7155c068aaf', 'request_id': 'req-890330de-92ba-44a3-830c-4cc48759c9cc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.733713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918cb2812b604888b832f7155c068aaf', 'request_id': 'req-890330de-92ba-44a3-830c-4cc48759c9cc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.749323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] The token cache is being invalidate because project 918cb2812b604888b832f7155c068aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:56.749484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.750559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.751788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-890330de-92ba-44a3-830c-4cc48759c9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:56.753523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.753867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.754647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] PATH_INFO: `/v3/users/b2d96b4a3c5649948dac2d02bf8848f7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.755598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1015/1999] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:56 2022] DELETE /identity/v3/projects/918cb2812b604888b832f7155c068aaf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:56.756796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d96b4a3c5649948dac2d02bf8848f7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.759564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:56.769004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b21c-1003-4459-825f-e57b6abb5434 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.769306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b21c-1003-4459-825f-e57b6abb5434 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.769978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b21c-1003-4459-825f-e57b6abb5434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.801268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0685b21c-1003-4459-825f-e57b6abb5434 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:56.802560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0685b21c-1003-4459-825f-e57b6abb5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.814324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1016/2000] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:56.822507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.822831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.823287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.850231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:56.851561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:56.860362 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1017/2001] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:56.864828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.874829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193c1d-97c9-4d93-8802-30bd82b4814e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.880447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.880782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.881095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.881377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.882153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:56.882469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.884114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:56.897927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1018/2002] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:23:56.903782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:56.915597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e620e86-01ba-4693-949a-580ce44a5324 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:56.920975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:56.922048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:56.922529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:56.923193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:56.934555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:56.939481 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.014760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d96b4a3c5649948dac2d02bf8848f7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.016261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d96b4a3c5649948dac2d02bf8848f7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.017022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d96b4a3c5649948dac2d02bf8848f7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.024348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d96b4a3c5649948dac2d02bf8848f7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.065990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1019/2003] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:57.070171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.072614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:57.154360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d96b4a3c5649948dac2d02bf8848f7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.163965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620d7d-6ada-4ed1-91a7-9c9653be7265 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.172159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.174312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.174557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.174843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.175561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.176617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 985/2004] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:56 2022] DELETE /identity/v3/users/b2d96b4a3c5649948dac2d02bf8848f7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:57.177461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.177666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.178943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:57.261517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6d782-6cde-40e2-a888-99ec1b67aba6 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.267556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.268470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.268949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.269099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] PATH_INFO: `/v3/projects/aa75ea91b53b4b7aa1e20f9275dd5e9c` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.270272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa75ea91b53b4b7aa1e20f9275dd5e9c)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.272212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.302368 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1020/2005] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:57 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:57.306632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.322254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fa958-c0ca-4b79-aa3f-c3cdef9e3a15 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.327646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.328992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.329164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.329439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.330183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.331824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.347691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1021/2006] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:57.348795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.361477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46b2d-4fdf-4d9d-8d48-8a1163961324 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.366781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.367479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.367766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.368046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.368801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.370838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.379986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:57.383905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1022/2007] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:57.388174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.402342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378fda-7d7c-4230-b1e8-842329a83e4e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.408602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.409584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.409885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.410582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] PATH_INFO: `/v3/projects/f8d37c1f726e4ad4a36f3463359bfef3/users/5fae4bb09baf43088c1ec3a3715f18a3/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.428811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa75ea91b53b4b7aa1e20f9275dd5e9c', 'request_id': 'req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.436302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d37c1f726e4ad4a36f3463359bfef3, user_id=5fae4bb09baf43088c1ec3a3715f18a3, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.439735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.495025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa75ea91b53b4b7aa1e20f9275dd5e9c', 'request_id': 'req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.508040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa75ea91b53b4b7aa1e20f9275dd5e9c', 'request_id': 'req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.524349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] The token cache is being invalidate because project aa75ea91b53b4b7aa1e20f9275dd5e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:57.524760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.525498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.527776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 986/2009] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:57 2022] DELETE /identity/v3/projects/aa75ea91b53b4b7aa1e20f9275dd5e9c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:57.528364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1023/2009] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:57 2022] PUT /identity/v3/projects/f8d37c1f726e4ad4a36f3463359bfef3/users/5fae4bb09baf43088c1ec3a3715f18a3/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:57.528683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.531858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:57.534353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:57.539093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:57.583923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:57.618760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc3e9-7e92-4af1-b3bc-c64d87650a72 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.668909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d99d0-9f7f-4513-983b-9c9cb2c900bf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:57.675118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.676123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.677289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.677289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] PATH_INFO: `/v3/users/f1c12b53f7264103bd0f122f51167295` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.678486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c12b53f7264103bd0f122f51167295)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.680514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.701250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:57.702205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:57.702503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:57.702959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] PATH_INFO: `/v3/projects/423bffa730da4ebbb18b6f900bcc983c` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:57.704359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423bffa730da4ebbb18b6f900bcc983c)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:57.707744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:57.913351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c12b53f7264103bd0f122f51167295'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.913767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423bffa730da4ebbb18b6f900bcc983c', 'request_id': 'req-e92b8961-2ac3-49e4-b329-16570572e376'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.927923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c12b53f7264103bd0f122f51167295'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.928656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c12b53f7264103bd0f122f51167295'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.929263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c12b53f7264103bd0f122f51167295'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.936590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-113bdc00-c3a9-4361-938b-43ebda0af6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c12b53f7264103bd0f122f51167295'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.985665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423bffa730da4ebbb18b6f900bcc983c', 'request_id': 'req-e92b8961-2ac3-49e4-b329-16570572e376'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:57.991994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423bffa730da4ebbb18b6f900bcc983c', 'request_id': 'req-e92b8961-2ac3-49e4-b329-16570572e376'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.005579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] The token cache is being invalidate because project 423bffa730da4ebbb18b6f900bcc983c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:58.005579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.005579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.007459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 987/2010] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:57 2022] DELETE /identity/v3/projects/423bffa730da4ebbb18b6f900bcc983c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:58.008080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.010775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.071509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1024/2011] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:57 2022] DELETE /identity/v3/users/f1c12b53f7264103bd0f122f51167295 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:58.072808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.073092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.073539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.079826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8961-2ac3-49e4-b329-16570572e376 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.102267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] MFA Rules not processed for user `5fae4bb09baf43088c1ec3a3715f18a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.103578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.142865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.143834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.144119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.144468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] PATH_INFO: `/v3/users/4d5fcb42740843e3bf3971dd6de50b93` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.145732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5fcb42740843e3bf3971dd6de50b93)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.147689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.174219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1025/2012] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.175529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.176971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.191950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cab27-68ce-44e9-b8fb-ce0d7f2cafd0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.194668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:58.196713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.197587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.197888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.198161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] PATH_INFO: `/v3/projects/2ff923a973d04f389cec531218a8b9c8` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.199375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff923a973d04f389cec531218a8b9c8)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.201290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.342636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff923a973d04f389cec531218a8b9c8', 'request_id': 'req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.342917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5fcb42740843e3bf3971dd6de50b93'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.344343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5fcb42740843e3bf3971dd6de50b93'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.345010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5fcb42740843e3bf3971dd6de50b93'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.349176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff923a973d04f389cec531218a8b9c8', 'request_id': 'req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.352253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5fcb42740843e3bf3971dd6de50b93'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.447170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff923a973d04f389cec531218a8b9c8', 'request_id': 'req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.450028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:58.464460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] The token cache is being invalidate because project 2ff923a973d04f389cec531218a8b9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:58.464774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.465444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-555d7809-27f4-4aa7-9cf6-32c94ead0e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.467029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1026/2013] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:58 2022] DELETE /identity/v3/projects/2ff923a973d04f389cec531218a8b9c8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:58.468390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a024d-f364-47ce-b4b8-d54407be456b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.468731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a024d-f364-47ce-b4b8-d54407be456b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.469009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a024d-f364-47ce-b4b8-d54407be456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.487766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b06a024d-f364-47ce-b4b8-d54407be456b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.489027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b06a024d-f364-47ce-b4b8-d54407be456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.544561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5fcb42740843e3bf3971dd6de50b93'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:58.548743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1027/2014] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.550159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257bc-7d5e-4dae-badd-7a9f10753b0e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.550450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257bc-7d5e-4dae-badd-7a9f10753b0e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.550725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257bc-7d5e-4dae-badd-7a9f10753b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.566055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 988/2015] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:58 2022] DELETE /identity/v3/users/4d5fcb42740843e3bf3971dd6de50b93 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:58.567210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.568934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.570531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b96257bc-7d5e-4dae-badd-7a9f10753b0e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.572344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b96257bc-7d5e-4dae-badd-7a9f10753b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.637827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1028/2016] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.639397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a177-6996-42b7-bf63-60291e185768 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.639691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a177-6996-42b7-bf63-60291e185768 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.640095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a177-6996-42b7-bf63-60291e185768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.661657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7b07a177-6996-42b7-bf63-60291e185768 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.662821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eb37-83a8-4d91-b0c8-836d103a68c8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.662937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7b07a177-6996-42b7-bf63-60291e185768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.672296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1029/2017] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.673744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.674039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.674319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.684476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.685053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.685346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.685662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.691495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.708122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.709798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.719825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1030/2018] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.720994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.722367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.763036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:58.791680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999bbf5-5a7b-4d82-a23a-fe9a77ac8027 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.798347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.799384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.799772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.800322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.808753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.811548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.812867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.814855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783c62e-f208-4012-bd4b-7d73529a0eb2 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.822295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:58.829803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1031/2019] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:58.830938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 989/2020] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:23:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:23:58.831287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.831586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.831734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.831934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.854893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dd44-ee25-4849-8d00-a4650d7ee850 service glance] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.856428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:58.857778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:58.873777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1032/2021] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:23:58.875751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.877825 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.880209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.880209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.880209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.880838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:58.881156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.883627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.886488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e45de-1786-4354-86c9-74a70f257805 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.891999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.892536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.892827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.893198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.894356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:23:58.894651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.897023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.914540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 990/2022] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:58.920231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1033/2023] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:23:58.920489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.921068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:58.935497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78acab-893e-48c1-8b49-8271ad98b8f2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.944013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f354-8901-469b-b8b3-1d5843317143 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:58.951039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.951648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.951933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.952273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.953130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.954035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:58.955365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:58.970304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:58.972167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:58.972167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:58.973887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:58.977768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.067110 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1034/2024] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:23:59.071327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.102645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 991/2025] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:23:58 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:59.110274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.142761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2e2-c818-476d-aa80-6dc8cb1077ef admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.163329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:59.229525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ab9d-d178-4aef-a686-0ffabc0160c5 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.237299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.238491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.238956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.239384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.240231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.242484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.243057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.245057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:59.246264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.246632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.246969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.247700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.251856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.364938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1035/2026] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:59 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:59.366331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.371088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:59.372594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 992/2027] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:23:59 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:23:59.373903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.383712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbf63-a0d1-40a1-80d3-2a1faddf328c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.386606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd83aeb-c945-405f-a4b6-f4433ad8266e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.388576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.389448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.399651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.399651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] PATH_INFO: `/v3/projects/b19216be9327447d8a36e95462a4b2af` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.399651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19216be9327447d8a36e95462a4b2af)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.400087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.400087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.400087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.400087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.400558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.400671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.400671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.410587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 993/2028] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:59.410587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.428342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39251892-a9e9-4fcb-b304-efde161e656f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.428342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.428342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.428342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.428685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.428685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.428685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.439439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 994/2029] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:59.440358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.453463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c9066-5a79-45c8-b5e3-78837a69cfae admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.464538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.465866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.465866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.465866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.467034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.469613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.482531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 995/2030] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:59.483448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.494700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198707-0ccb-4bf0-836b-0f9c91d22987 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.499368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.500110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.500398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.500683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.501449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.503171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.513453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 996/2031] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:23:59.514405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.516281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:59.528128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19216be9327447d8a36e95462a4b2af', 'request_id': 'req-11add357-aff9-4768-be79-15e1b391aa26'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.530436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef8ad-50c7-4acb-a775-0d5456a5b191 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.534941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19216be9327447d8a36e95462a4b2af', 'request_id': 'req-11add357-aff9-4768-be79-15e1b391aa26'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.593138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.594664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.595016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.595291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] PATH_INFO: `/v3/projects/a7ec9d9fbc064d1b945ef94181b5ab1c` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.596509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ec9d9fbc064d1b945ef94181b5ab1c)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.598578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.613528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19216be9327447d8a36e95462a4b2af', 'request_id': 'req-11add357-aff9-4768-be79-15e1b391aa26'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.632930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] The token cache is being invalidate because project b19216be9327447d8a36e95462a4b2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:59.633225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.633940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.635497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1036/2032] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:59 2022] DELETE /identity/v3/projects/b19216be9327447d8a36e95462a4b2af => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:59.636315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.637693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:59.651353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add357-aff9-4768-be79-15e1b391aa26 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.656993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.657930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.658216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.658495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] PATH_INFO: `/v3/projects/a87aeef6c9ba4a69a41300b0997c6a98/users/8e0f6ab51c014c56a9855fad2948200f/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.673985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87aeef6c9ba4a69a41300b0997c6a98, user_id=8e0f6ab51c014c56a9855fad2948200f, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.676775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.770073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1037/2033] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:59 2022] PUT /identity/v3/projects/a87aeef6c9ba4a69a41300b0997c6a98/users/8e0f6ab51c014c56a9855fad2948200f/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:59.770781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.772800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:59.779376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ec9d9fbc064d1b945ef94181b5ab1c', 'request_id': 'req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.845470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674513-6b1c-4114-b486-e20a139376c4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.846644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ec9d9fbc064d1b945ef94181b5ab1c', 'request_id': 'req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.850765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.851598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.851879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.852186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] PATH_INFO: `/v3/projects/80b06b0506d543c48677d3c6aa6e6d58/users/3a5fe1db34e142a79f398105dae79fce/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.854266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ec9d9fbc064d1b945ef94181b5ab1c', 'request_id': 'req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.867542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] The token cache is being invalidate because project a7ec9d9fbc064d1b945ef94181b5ab1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:23:59.867863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.868177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b06b0506d543c48677d3c6aa6e6d58, user_id=3a5fe1db34e142a79f398105dae79fce, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.868674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:23:59.870326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 997/2034] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:23:59 2022] DELETE /identity/v3/projects/a7ec9d9fbc064d1b945ef94181b5ab1c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:59.871257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:23:59.871367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3e07-8001-4f62-8a3e-9ca69f4abe5c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.872581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:23:59.937693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f2-47f3-4dbf-bfb2-b4eafbcc947f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:23:59.942523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:23:59.943460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.943783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.943962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] PATH_INFO: `/v3/users/dc1ce8895fa34aa08298549f70c7a2cc` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.945199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1ce8895fa34aa08298549f70c7a2cc)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:23:59.947213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:23:59.957401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:23:59.963369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1038/2035] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:23:59 2022] PUT /identity/v3/projects/80b06b0506d543c48677d3c6aa6e6d58/users/3a5fe1db34e142a79f398105dae79fce/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:23:59.964874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:23:59.964994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:23:59.965277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:23:59.994861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] MFA Rules not processed for user `8e0f6ab51c014c56a9855fad2948200f`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:23:59.996366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.080943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1039/2036] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:23:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:00.081803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:00.083135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.113593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:00.164301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1ce8895fa34aa08298549f70c7a2cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.164511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8d797-2b18-4757-a189-8644007e6b17 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:00.165547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1ce8895fa34aa08298549f70c7a2cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.166549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1ce8895fa34aa08298549f70c7a2cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.170028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:00.170925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:00.171212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:00.171601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] PATH_INFO: `/v3/users/e250db0b61e144d8a41122724af427b8` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:00.172859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e250db0b61e144d8a41122724af427b8)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:00.174883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:00.178255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1ce8895fa34aa08298549f70c7a2cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.273294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e51771b3-5e8c-4484-a742-a7405ac78aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1ce8895fa34aa08298549f70c7a2cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.290535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 998/2037] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:23:59 2022] DELETE /identity/v3/users/dc1ce8895fa34aa08298549f70c7a2cc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:00.291848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:00.292135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:00.292410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:00.325315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] MFA Rules not processed for user `3a5fe1db34e142a79f398105dae79fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:00.326677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.400053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e250db0b61e144d8a41122724af427b8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.409542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 999/2038] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:00.410545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:00.411963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.417007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e250db0b61e144d8a41122724af427b8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.417771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e250db0b61e144d8a41122724af427b8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.418395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e250db0b61e144d8a41122724af427b8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.427637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e250db0b61e144d8a41122724af427b8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:00.495505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf25a-800b-438f-a17a-c58578b3334d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:00.502185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:00.502877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:00.503160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:00.503449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:00.505463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.546301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1040/2039] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:00 2022] DELETE /identity/v3/users/e250db0b61e144d8a41122724af427b8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:00.548040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:00.549743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.608147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:00.613042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:00.633106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1000/2040] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:00.638648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ad3f1-38c7-4f5c-8523-a1414b6d3d28 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:00.643716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:00.646135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:00.647606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:00.648039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:00.648763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:00.658743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:00.737107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:00.820607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:00.822603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:00.838794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1041/2041] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:00.952989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:00.955762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:01.103134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:01.194473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:01.196718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bd831-d9fa-4183-8261-fea6fad76d89 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:01.198276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:01.331502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1eb27-f97d-4272-bdc3-de731a705cc7 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:01.336876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:01.338160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:01.338448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:01.338733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] PATH_INFO: `/v3/users/8e0f6ab51c014c56a9855fad2948200f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:01.340096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0f6ab51c014c56a9855fad2948200f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:01.342098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:01.475725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:01.475725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:01.475725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:01.475725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] PATH_INFO: `/v3/projects/c943b097ad5e406287f8fb4d103056d7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:01.479233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c943b097ad5e406287f8fb4d103056d7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:01.479233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:01.709719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0f6ab51c014c56a9855fad2948200f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.709998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c943b097ad5e406287f8fb4d103056d7', 'request_id': 'req-57c077e5-abfb-4dda-aed6-ad36d63ce639'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.723956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:01.725431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0f6ab51c014c56a9855fad2948200f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.737650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0f6ab51c014c56a9855fad2948200f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.737650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0f6ab51c014c56a9855fad2948200f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.737650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-443bd27c-6f70-4e9d-9921-be3213931c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0f6ab51c014c56a9855fad2948200f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.825127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c943b097ad5e406287f8fb4d103056d7', 'request_id': 'req-57c077e5-abfb-4dda-aed6-ad36d63ce639'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.832694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c943b097ad5e406287f8fb4d103056d7', 'request_id': 'req-57c077e5-abfb-4dda-aed6-ad36d63ce639'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.847101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] The token cache is being invalidate because project c943b097ad5e406287f8fb4d103056d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:01.847429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.848083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:01.849692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1001/2042] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:00 2022] DELETE /identity/v3/projects/c943b097ad5e406287f8fb4d103056d7 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:01.850468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:01.854371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:01.912298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1042/2043] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:01 2022] DELETE /identity/v3/users/8e0f6ab51c014c56a9855fad2948200f => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:01.916383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e34-9269-4574-8552-854ebe22401f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:01.916383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e34-9269-4574-8552-854ebe22401f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:01.916383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88e34-9269-4574-8552-854ebe22401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:01.948215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c077e5-abfb-4dda-aed6-ad36d63ce639 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:01.948401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-97f88e34-9269-4574-8552-854ebe22401f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:01.948401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-97f88e34-9269-4574-8552-854ebe22401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.019488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.020506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.020925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.021273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] PATH_INFO: `/v3/projects/561c18c32954441b83688edec54c99e0` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.022713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561c18c32954441b83688edec54c99e0)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.024739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.049899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1043/2044] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:02.051558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436117e-3ced-41d3-9f8f-2977642bdae7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.052009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436117e-3ced-41d3-9f8f-2977642bdae7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.052460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436117e-3ced-41d3-9f8f-2977642bdae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.071697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5436117e-3ced-41d3-9f8f-2977642bdae7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:02.072907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5436117e-3ced-41d3-9f8f-2977642bdae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.085586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1044/2045] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:02.087289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.087519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.087853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.107218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:02.108424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.116445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1045/2046] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:02.120127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.120127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.152642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:02.173124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561c18c32954441b83688edec54c99e0', 'request_id': 'req-ba47c632-870f-417f-8cb4-b90039d56bb1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:02.185000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53fbd-29ab-46ab-9834-4b99d55a1f30 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.238899 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.239644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.239855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.240138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.268982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561c18c32954441b83688edec54c99e0', 'request_id': 'req-ba47c632-870f-417f-8cb4-b90039d56bb1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:02.271709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561c18c32954441b83688edec54c99e0', 'request_id': 'req-ba47c632-870f-417f-8cb4-b90039d56bb1'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:02.283343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:02.284235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] The token cache is being invalidate because project 561c18c32954441b83688edec54c99e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:02.284527 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:02.285196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:02.287024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1002/2047] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:01 2022] DELETE /identity/v3/projects/561c18c32954441b83688edec54c99e0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:02.287553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.289016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.315511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.316980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1a87a-0845-4329-90fe-f76289517b0c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.327318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1046/2048] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:02.330658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175edf1-d760-4cb8-9038-8f4d04cc449f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.330950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175edf1-d760-4cb8-9038-8f4d04cc449f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.331235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175edf1-d760-4cb8-9038-8f4d04cc449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.351115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6175edf1-d760-4cb8-9038-8f4d04cc449f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:02.352647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6175edf1-d760-4cb8-9038-8f4d04cc449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.362610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1047/2049] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:02.366351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47c632-870f-417f-8cb4-b90039d56bb1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.371645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.371948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.372305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.372437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.373067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.373906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.373906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.374981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:02.375622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.377483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.391580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1003/2050] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:02.392779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:02.394083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.396030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.404973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1048/2051] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:02.408774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ed02b-7a2f-4a5a-ada6-c4c63b4daabb admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.409893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.415234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.415928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.416229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.416492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.417192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.419149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.421296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd221bc9-52c2-4b2d-af57-4e9b8f5e8ce6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.426951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.427794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.428096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.428538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.429343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:02.429686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.431389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.444131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1049/2052] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:02.448988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.459029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6736aa-9cdb-4935-a741-56bfae9f6472 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.463925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.464606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.464889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.465165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.465985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.467993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.548005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1004/2053] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:02.552412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.573043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1050/2054] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:02.578256 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.644726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684468c-a29a-4edb-acb6-12f531ec9952 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.684605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a5b6-9fb6-4c77-9abb-f0bf70ef9f01 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.694873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.695764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.696463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.696745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.697452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.699768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.729071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:02.739371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.740063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.740363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.740718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.741484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.743435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.813090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1051/2055] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:02.817004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.827219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb874a-63cf-4694-9c0f-15339c89e34d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.832526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.833195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.833477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.833774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.834502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.836123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.845913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1005/2056] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:02 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:02.846953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.850188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:02.851135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1052/2057] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:02.851950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.870471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d70680-3615-4c9a-9e5b-a0756b427ac6 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.874529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304f74f-f63e-4cb0-857c-ce319c64db86 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.885930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.886942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.887309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.887588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] PATH_INFO: `/v3/projects/a87aeef6c9ba4a69a41300b0997c6a98` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.888908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87aeef6c9ba4a69a41300b0997c6a98)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.891077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.891765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.891908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.892053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.892333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.893079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.894773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.908036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1053/2058] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:02.908036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.918086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e65e-b92e-43d9-9af7-2473031be0f6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.923409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.924072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.924361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.924645 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.925377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.927238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.941461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1054/2059] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:02.943605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.953534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684332b2-3665-4e65-8583-795ce1340594 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:02.958931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:02.959608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:02.960076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:02.960457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:02.961373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:02.963337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:02.976394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1055/2060] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:02.977220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:02.988844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717927-b7da-437a-aa1f-9cec5fdfa1b7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.002217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.003125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.003411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.003692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] PATH_INFO: `/v3/projects/eb6b245b76ff464397d9eef7ab39b870/users/8ec5c606ae3646a18552ade48b714076/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.019814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6b245b76ff464397d9eef7ab39b870, user_id=8ec5c606ae3646a18552ade48b714076, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.022518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.122724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1056/2061] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:02 2022] PUT /identity/v3/projects/eb6b245b76ff464397d9eef7ab39b870/users/8ec5c606ae3646a18552ade48b714076/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:03.123617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.131294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87aeef6c9ba4a69a41300b0997c6a98', 'request_id': 'req-fc056b63-efe2-4e05-9af4-a94bd0fec640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:03.141025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:03.186768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:03.199479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d7d-188b-471f-b013-df86e5b0c2ff admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.214130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87aeef6c9ba4a69a41300b0997c6a98', 'request_id': 'req-fc056b63-efe2-4e05-9af4-a94bd0fec640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:03.225205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87aeef6c9ba4a69a41300b0997c6a98', 'request_id': 'req-fc056b63-efe2-4e05-9af4-a94bd0fec640'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:03.237155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] The token cache is being invalidate because project a87aeef6c9ba4a69a41300b0997c6a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:03.237445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:03.238151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-fc056b63-efe2-4e05-9af4-a94bd0fec640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:03.239703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1006/2062] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:02 2022] DELETE /identity/v3/projects/a87aeef6c9ba4a69a41300b0997c6a98 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:03.241014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881cdfa-2d59-45a7-8c0e-ec4e9dc7c631 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.241295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881cdfa-2d59-45a7-8c0e-ec4e9dc7c631 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.241593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881cdfa-2d59-45a7-8c0e-ec4e9dc7c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.261421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.262390 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.262685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.262959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] PATH_INFO: `/v3/projects/9317ef7adbb94ce2af68daacd756a87c/users/9fd81e9490e848ac9d2de49116be6364/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.271115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e881cdfa-2d59-45a7-8c0e-ec4e9dc7c631 None None] MFA Rules not processed for user `8ec5c606ae3646a18552ade48b714076`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:03.272357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e881cdfa-2d59-45a7-8c0e-ec4e9dc7c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.279773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9317ef7adbb94ce2af68daacd756a87c, user_id=9fd81e9490e848ac9d2de49116be6364, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.282591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.347752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1007/2063] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:03.349064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d47-7a37-4f37-8d62-606d35e79854 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.349421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d47-7a37-4f37-8d62-606d35e79854 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.349836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d47-7a37-4f37-8d62-606d35e79854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.356821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1057/2064] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:03 2022] PUT /identity/v3/projects/9317ef7adbb94ce2af68daacd756a87c/users/9fd81e9490e848ac9d2de49116be6364/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:03.357611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.360531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.375892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-de491d47-7a37-4f37-8d62-606d35e79854 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:03.377413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-de491d47-7a37-4f37-8d62-606d35e79854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.441725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f02-15a2-4737-b552-96ef5d8ace0e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.446953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.447626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.447923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.448205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.448905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.449286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1008/2065] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:03.450764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.451005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b96ce0-8a21-4c6e-85e9-53539f1b1f91 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.451130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.451313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.486994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] MFA Rules not processed for user `9fd81e9490e848ac9d2de49116be6364`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:03.486994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.526174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:03.535940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1058/2066] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:03.540864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.540864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.540864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.554853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1009/2067] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:03.555828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.558407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:03.559955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.572728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398082-251a-4bd7-9684-7660edc72219 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.581351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:03.630071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1059/2068] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:03.631150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.635776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:03.641969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.642700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.642988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.643264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.643967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.645944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.699179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47809ec5-c5ca-4592-8b77-d89d2ed2d2ad None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.705005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.705725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.706027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.706304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.732926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1010/2069] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:03.734495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.750722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda91f-503b-4d9d-9052-3aef48456aee admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.755677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.756391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.756685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.756971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.757754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:03.758071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.759695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.773267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1011/2070] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:03.775889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.782252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.784717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.788239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0a04-9972-4c16-8456-ee1fb4f0d968 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.795478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.796108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1060/2071] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:03.797209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.799201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.799757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.800494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.801973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.805435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.809134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2c2-2df6-4b7d-8a05-3d295da44808 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.817969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.818682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.818978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.819374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.820048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1012/2072] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:03.822252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.823753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.825745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.839346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6170-e92a-4593-8581-0b72a54f2842 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:03.845073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:03.846075 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:03.846367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:03.846667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] PATH_INFO: `/v3/projects/30a24f9923a847a4bb3f677aed6622f1/users/709c7af8fa1c4fa38bb9a66878de3e6b/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:03.868212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a24f9923a847a4bb3f677aed6622f1, user_id=709c7af8fa1c4fa38bb9a66878de3e6b, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:03.870998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:03.941652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1061/2073] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:03.945749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:03.964119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1013/2074] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:03 2022] PUT /identity/v3/projects/30a24f9923a847a4bb3f677aed6622f1/users/709c7af8fa1c4fa38bb9a66878de3e6b/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:03.968138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.026623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:04.032920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1da23-9aaf-44ae-a942-eeaea13a53b9 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.059463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d4c9-d54f-41e6-b0db-6918a44735a1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.065673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.066361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.066708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.067036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.067788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.069412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.085999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1014/2075] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:04.090623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.104570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d05671-ee47-4cba-81ea-3daa5dcc7804 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.110865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.111767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.112073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.112413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] PATH_INFO: `/v3/projects/30a24f9923a847a4bb3f677aed6622f1/users/709c7af8fa1c4fa38bb9a66878de3e6b/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.115181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a24f9923a847a4bb3f677aed6622f1, user_id=709c7af8fa1c4fa38bb9a66878de3e6b, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.118144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816be58-b1b3-42f1-852a-014eb7b58e12 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.127914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.129801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.129801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.129801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.130066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.132047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.133870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1015/2076] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:04 2022] PUT /identity/v3/projects/30a24f9923a847a4bb3f677aed6622f1/users/709c7af8fa1c4fa38bb9a66878de3e6b/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:04.145192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.145382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.145691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.153249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:04.177017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] MFA Rules not processed for user `709c7af8fa1c4fa38bb9a66878de3e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:04.189258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:04.250902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1062/2077] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:03 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:04.255619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.268337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694a283-09b3-465e-a373-a60e14f3efa1 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.285920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1016/2078] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:04.352237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.352919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.353206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.353482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.354338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.361440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.369354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1063/2079] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:04.373462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.385358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53cbd-6728-413a-867a-c7534d79e8b1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.389958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.390687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.391184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.391304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.392037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.393665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.407292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1017/2080] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:04.410109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.420717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97288361-d490-45ed-bfa0-8050e72d1781 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.429230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.430304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.430421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.430692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] PATH_INFO: `/v3/projects/b2039de92b4f40c0a1870c1807d7b8ef/users/7b1e110a1269493e86a66fdc514f6d46/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.442539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.445973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:04.448690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2039de92b4f40c0a1870c1807d7b8ef, user_id=7b1e110a1269493e86a66fdc514f6d46, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.451463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.507831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fbc88-5ded-4647-bd2b-fb4fcad4a5b7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.511591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.512247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.512529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.512804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.523157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.524613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32322f21-e835-434b-a0f7-65b8943f0fe5 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.535886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1018/2081] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:04.557591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1064/2082] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:04 2022] PUT /identity/v3/projects/b2039de92b4f40c0a1870c1807d7b8ef/users/7b1e110a1269493e86a66fdc514f6d46/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:04.564983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.565631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.566093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.601329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] MFA Rules not processed for user `7b1e110a1269493e86a66fdc514f6d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:04.602709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:04.703410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.706066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1019/2083] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:04.710093 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.721903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:04.770222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2829-5177-4700-93a0-fd71fbebf08a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.774309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.775015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.775299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.775572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.782136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66006e7-ca6f-483f-a9e2-2d83e70ebb27 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:04.786704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:04.787384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:04.787752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:04.788071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:04.788779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.790734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.798204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:04.847435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:04.856598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:04.859595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1065/2084] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:04.935020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1020/2085] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:04 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:04.936058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:04.953462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c299ba-deae-4f22-929f-d9c4981e54ce service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.031824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.032496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.032790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.033272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.034173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.036062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.164112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1066/2086] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:04 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:05.165247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:05.176783 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9525326-0650-46f8-8e6b-dcd25937b2d0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.181414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.182115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.182399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.182675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.183471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.185045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.196540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1021/2087] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:05.200941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:05.211162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6b31-1a8b-4f6f-bc2e-ab8993fe7817 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.215826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.216702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.216983 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.217254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] PATH_INFO: `/v3/projects/c70f5513b42944fea29cbd49caea2526/users/0cbc159c62b345888902767ba239c3c7/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.232774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70f5513b42944fea29cbd49caea2526, user_id=0cbc159c62b345888902767ba239c3c7, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.236121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.340443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1067/2088] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:05 2022] PUT /identity/v3/projects/c70f5513b42944fea29cbd49caea2526/users/0cbc159c62b345888902767ba239c3c7/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:05.344848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:05.355605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef42c-ad91-42a7-84e8-53ad575abb5d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.424877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.425484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.425807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.426090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.426827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.429228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea63a9-f310-4ea0-89d1-8a8ee1b6ccc2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.442099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1022/2089] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:05.450874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:05.455952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731e8d-8c6d-4f7b-ba82-273db39ec573 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.460727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.461910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.462192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.462472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] PATH_INFO: `/v3/projects/c70f5513b42944fea29cbd49caea2526/users/0cbc159c62b345888902767ba239c3c7/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.464643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70f5513b42944fea29cbd49caea2526, user_id=0cbc159c62b345888902767ba239c3c7, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.467445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.486655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1068/2090] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:05 2022] PUT /identity/v3/projects/c70f5513b42944fea29cbd49caea2526/users/0cbc159c62b345888902767ba239c3c7/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:05.494770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.495060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.495337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.524106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] MFA Rules not processed for user `0cbc159c62b345888902767ba239c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:05.525332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:05.605529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1023/2091] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:05.664868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:05.732159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9c4b-a114-40fc-88d9-2b4a96f8d917 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:05.736326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:05.737221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:05.737545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:05.737867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:05.753155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:05.754731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:05.766350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1069/2092] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:06.877390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:06.879509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:06.886642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:06.912925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:06.925007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03e877-6fb6-4c85-85b0-eea46a16b558 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:06.933936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbc159c62b345888902767ba239c3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70f5513b42944fea29cbd49caea2526', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:06.933936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:06.933936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:06.934306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:06.934306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:06.934306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:06.934938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:06.944483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:06.948079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1070/2093] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:06.952337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:06.962136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2a27-8444-4603-9cea-e29926f7ba8c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:06.962801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0b43d-bea6-450a-a349-6156f19b2337 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:06.966687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:06.967798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbc159c62b345888902767ba239c3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70f5513b42944fea29cbd49caea2526', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:06.967992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:06.969001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:06.969220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:06.969424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:06.969627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] PATH_INFO: `/v3/users/3a5fe1db34e142a79f398105dae79fce` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:06.969751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:06.970677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:06.971996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5fe1db34e142a79f398105dae79fce)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:06.972665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:06.973965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:07.089413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1071/2094] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:06 2022] POST /identity/v3/projects => generated 353 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:07.093440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:07.175229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934532f-0973-4875-b265-95797654ac4c tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:07.180339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbc159c62b345888902767ba239c3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70f5513b42944fea29cbd49caea2526', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:07.181013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:07.181306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:07.181620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:07.182364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:07.182680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:07.184448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:07.200086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1072/2095] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:07.236647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5fe1db34e142a79f398105dae79fce'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.237617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5fe1db34e142a79f398105dae79fce'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.238299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5fe1db34e142a79f398105dae79fce'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.244885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:07.246855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:07.248475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5fe1db34e142a79f398105dae79fce'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.261235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4def-fd03-4eb7-854e-a7b27a01ad39 tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:07.267365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbc159c62b345888902767ba239c3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c70f5513b42944fea29cbd49caea2526', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:07.268258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:07.268549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:07.268835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] PATH_INFO: `/v3/projects/2517a79b333a45de96ac6ad9411039c3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:07.270357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2517a79b333a45de96ac6ad9411039c3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:07.272353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:07.361616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-934b2fa1-c256-473a-8427-cbdeca247f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5fe1db34e142a79f398105dae79fce'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.392969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1024/2096] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:06 2022] DELETE /identity/v3/users/3a5fe1db34e142a79f398105dae79fce => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:07.394970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:07.395827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:07.396292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:07.424558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:07.425808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:07.433762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2517a79b333a45de96ac6ad9411039c3', 'request_id': 'req-c3b83638-b8da-4e8f-a4aa-167014e11fde'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.452562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2517a79b333a45de96ac6ad9411039c3', 'request_id': 'req-c3b83638-b8da-4e8f-a4aa-167014e11fde'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.509418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1025/2097] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:07.519788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:07.521542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:07.556125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:07.565313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2517a79b333a45de96ac6ad9411039c3', 'request_id': 'req-c3b83638-b8da-4e8f-a4aa-167014e11fde'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.579282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] The token cache is being invalidate because project 2517a79b333a45de96ac6ad9411039c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:07.579580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.580290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:07.582155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1073/2098] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:07 2022] DELETE /identity/v3/projects/2517a79b333a45de96ac6ad9411039c3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:07.589370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbac89f-1597-4bf4-80ab-9f7fd18897ba None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:07.593039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:07.594506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:07.594717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:07.596363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:07.597126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:07.610197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:07.612127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:07.622916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1026/2099] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:08.168487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.170318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.195617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b83638-b8da-4e8f-a4aa-167014e11fde tempest-VolumeQuotaClassesTest-716677709 tempest-VolumeQuotaClassesTest-716677709-project-admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.201118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.202045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.202360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.202651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] PATH_INFO: `/v3/projects/80b06b0506d543c48677d3c6aa6e6d58` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.204970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b06b0506d543c48677d3c6aa6e6d58)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.207062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.304218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.306549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.319493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621567ae-8800-4335-8d2f-a3f4db4c24d0 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.338290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b06b0506d543c48677d3c6aa6e6d58', 'request_id': 'req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.339695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:08.344878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b06b0506d543c48677d3c6aa6e6d58', 'request_id': 'req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.386261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.387016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.387297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.387572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] PATH_INFO: `/v3/users/7b1e110a1269493e86a66fdc514f6d46` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.388761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1e110a1269493e86a66fdc514f6d46)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.391391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.442393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b06b0506d543c48677d3c6aa6e6d58', 'request_id': 'req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.455669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] The token cache is being invalidate because project 80b06b0506d543c48677d3c6aa6e6d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:08.456083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.457179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dec6bbc3-7c59-41ea-8971-fb5aab06e8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.462277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1074/2100] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:08 2022] DELETE /identity/v3/projects/80b06b0506d543c48677d3c6aa6e6d58 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:08.463735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b286a-c3ba-4f23-b75a-53b83f945377 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.464066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b286a-c3ba-4f23-b75a-53b83f945377 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.464301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b286a-c3ba-4f23-b75a-53b83f945377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.490849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-502b286a-c3ba-4f23-b75a-53b83f945377 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:08.492101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-502b286a-c3ba-4f23-b75a-53b83f945377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.514149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1075/2101] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:08.530169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.530564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.531026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.559657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:08.561100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.573860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1076/2102] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:08.575851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.585598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f33a-ed34-4e54-befd-fdabff050427 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.590915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.591684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.591968 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.592264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.593047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:08.593378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.595382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.613706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1077/2103] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:08.621874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.633129 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1e110a1269493e86a66fdc514f6d46'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.633977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504791c-82b8-455a-a143-7a72e27cfecd admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.635998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1e110a1269493e86a66fdc514f6d46'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.637858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1e110a1269493e86a66fdc514f6d46'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.639529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.640203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.640538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.640923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.641796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.643847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.658443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1e110a1269493e86a66fdc514f6d46'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.745341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-93278585-ff57-4600-8cbe-5b92018b399a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1e110a1269493e86a66fdc514f6d46'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:08.754787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1078/2104] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:08 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:08.758755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.761174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.767880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1027/2105] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:08 2022] DELETE /identity/v3/users/7b1e110a1269493e86a66fdc514f6d46 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:08.772836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.773201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.773628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.799754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:08.801012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.837590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbefb-49d4-45c4-ad3d-9b39ee55de79 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.847728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:08.873711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1028/2106] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:08.888793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:08.892898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:08.908171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.909172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.913270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.913612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.914341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.916284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.956531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869d0c-b73e-43d5-8101-badb5f15a96e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:08.960408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:08.961170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:08.961462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:08.961780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:08.976570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:08.978140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:08.988755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1029/2107] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:09.038078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1079/2108] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:08 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:09.042400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.053581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e99717-c3a5-4806-b88a-e023911dd5ae service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.058513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.059183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.059474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.059777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.060510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.062152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.073039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1030/2109] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:09.077046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.087638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b72e8-49d6-4af5-8c27-2683c3b3145b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.093212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.094798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.095219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.095519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.096272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.098099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.110359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1080/2110] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:09.114452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.124982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb0384-8ce6-410f-b6cd-ea291d5fb4ee admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.129938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.133328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.133328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.133328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] PATH_INFO: `/v3/projects/311049591d254a94b2759592e29f1c10/users/f0169e3cfa8d4c9a9376e2ec57fafe1f/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.134366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.136106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.147722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311049591d254a94b2759592e29f1c10, user_id=f0169e3cfa8d4c9a9376e2ec57fafe1f, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.149194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d1df9-90b5-41c8-8e80-1f7605b2841c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.150366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7327-92ec-493b-969e-2430b53d85d6 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.154646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.155622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.156529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.156820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] PATH_INFO: `/v3/users/8ec5c606ae3646a18552ade48b714076` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.158254 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec5c606ae3646a18552ade48b714076)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.163220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.172829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:09.237997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1031/2111] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:09 2022] PUT /identity/v3/projects/311049591d254a94b2759592e29f1c10/users/f0169e3cfa8d4c9a9376e2ec57fafe1f/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:09.248767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.249054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.249332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.278746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] MFA Rules not processed for user `f0169e3cfa8d4c9a9376e2ec57fafe1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:09.279953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.365477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1032/2112] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:09.371265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec5c606ae3646a18552ade48b714076'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.378051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.379378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.384625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec5c606ae3646a18552ade48b714076'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.385342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec5c606ae3646a18552ade48b714076'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.385965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec5c606ae3646a18552ade48b714076'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.393493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec5c606ae3646a18552ade48b714076'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.432055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:09.443020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332dea-5b24-42ba-a424-ee1dc252a48e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.453632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.453632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.453632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.453632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.454119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.463026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.466044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb699d-6083-41d4-8fe3-a637757a6e00 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.476294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1081/2113] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:09 2022] DELETE /identity/v3/users/8ec5c606ae3646a18552ade48b714076 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:09.477334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.485219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1033/2114] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:09.486690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.486865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.487160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.488181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.505719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:09.506979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.591672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d449f-3ad0-421b-b21e-a9d304467e92 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.597385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.598193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1034/2115] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:09.598332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.598644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.599022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] PATH_INFO: `/v3/projects/b2039de92b4f40c0a1870c1807d7b8ef` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.600340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2039de92b4f40c0a1870c1807d7b8ef)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.602559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.613199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.614989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:09.682385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f328f30-54e3-4df0-b51e-9cac40a73e13 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.686322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.695868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.696277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.698146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.708289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.709813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:09.711320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2039de92b4f40c0a1870c1807d7b8ef', 'request_id': 'req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.718602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2039de92b4f40c0a1870c1807d7b8ef', 'request_id': 'req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.723753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1035/2116] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:09.801866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2039de92b4f40c0a1870c1807d7b8ef', 'request_id': 'req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.815531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] The token cache is being invalidate because project b2039de92b4f40c0a1870c1807d7b8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:09.815937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.817243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:09.819409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1082/2117] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:09 2022] DELETE /identity/v3/projects/b2039de92b4f40c0a1870c1807d7b8ef => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:09.823272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:09.835111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555eff5-c44c-4b0a-bae2-a65c7efebbeb service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:09.912433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:09.913367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:09.914286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:09.914286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] PATH_INFO: `/v3/users/0cbc159c62b345888902767ba239c3c7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:09.916012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbc159c62b345888902767ba239c3c7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:09.919034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:10.169728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:10.182379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbc159c62b345888902767ba239c3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.183037 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbc159c62b345888902767ba239c3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.183648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbc159c62b345888902767ba239c3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.200729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbc159c62b345888902767ba239c3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.263789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:10.266350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:10.286444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbc159c62b345888902767ba239c3c7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.295782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5c1f9-7e33-4bcd-aafb-222758804ad4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:10.305341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:10.306697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:10.307133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:10.307751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] PATH_INFO: `/v3/projects/eb6b245b76ff464397d9eef7ab39b870` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:10.313363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6b245b76ff464397d9eef7ab39b870)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:10.314851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:10.324973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1036/2118] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:09 2022] DELETE /identity/v3/users/0cbc159c62b345888902767ba239c3c7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:10.336305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:10.487632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6b245b76ff464397d9eef7ab39b870', 'request_id': 'req-a1886ab8-68c6-4127-9eaa-c149f629e307'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.493189 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6b245b76ff464397d9eef7ab39b870', 'request_id': 'req-a1886ab8-68c6-4127-9eaa-c149f629e307'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.609850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6b245b76ff464397d9eef7ab39b870', 'request_id': 'req-a1886ab8-68c6-4127-9eaa-c149f629e307'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.623239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] The token cache is being invalidate because project eb6b245b76ff464397d9eef7ab39b870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:10.623533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.625360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.627176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1083/2119] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:10 2022] DELETE /identity/v3/projects/eb6b245b76ff464397d9eef7ab39b870 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:10.631286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:10.633314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:10.714334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dcab3-1b27-46cf-9205-5c1685a39fd4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:10.763992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:10.766298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:10.778511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:10.779667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:10.779927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:10.780216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] PATH_INFO: `/v3/users/709c7af8fa1c4fa38bb9a66878de3e6b` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:10.781497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=709c7af8fa1c4fa38bb9a66878de3e6b)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:10.783669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:10.853176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886ab8-68c6-4127-9eaa-c149f629e307 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:10.857889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:10.858754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:10.859041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:10.859959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] PATH_INFO: `/v3/projects/c70f5513b42944fea29cbd49caea2526` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:10.861259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70f5513b42944fea29cbd49caea2526)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:10.863320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:10.994526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709c7af8fa1c4fa38bb9a66878de3e6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.995321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709c7af8fa1c4fa38bb9a66878de3e6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:10.998368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709c7af8fa1c4fa38bb9a66878de3e6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.007559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70f5513b42944fea29cbd49caea2526', 'request_id': 'req-e5de4e18-6545-4dc3-9b93-ad488001273e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.012114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709c7af8fa1c4fa38bb9a66878de3e6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.014963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70f5513b42944fea29cbd49caea2526', 'request_id': 'req-e5de4e18-6545-4dc3-9b93-ad488001273e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.018650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:11.132796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e75a3136-e349-4d0a-a7fe-cc731565e680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709c7af8fa1c4fa38bb9a66878de3e6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.155876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1037/2120] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:10 2022] DELETE /identity/v3/users/709c7af8fa1c4fa38bb9a66878de3e6b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:11.259299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70f5513b42944fea29cbd49caea2526', 'request_id': 'req-e5de4e18-6545-4dc3-9b93-ad488001273e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.272449 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] The token cache is being invalidate because project c70f5513b42944fea29cbd49caea2526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:11.273137 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.273853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e5de4e18-6545-4dc3-9b93-ad488001273e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.275902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1084/2121] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:10 2022] DELETE /identity/v3/projects/c70f5513b42944fea29cbd49caea2526 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:11.281482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.281801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.282089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.315655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:11.316900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:11.394187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1038/2122] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:11.402583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.402880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.403167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.423834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:11.425060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:11.438331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1085/2123] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:11.442997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.453788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6876a-09cf-449b-95f6-bc1d417127b2 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.460683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.461522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.461987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.462286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.463013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:11.463328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.465379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.480636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1039/2124] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:11.486848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.497995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eca80-e16f-4602-bfcc-e581c28138b3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.509709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.509709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.509709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.509709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.510279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.512286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.633788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.634264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1086/2125] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:11 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:11.636405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:11.638935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.648813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:11.661359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc6bb-3a85-4292-892d-dd43dbbcee93 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.731282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b9de-2f6f-4cfa-8937-34a8f7269bb5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.737059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.737888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.738176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.738460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.739302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.741272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.753217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.754149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.754529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.754756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] PATH_INFO: `/v3/projects/30a24f9923a847a4bb3f677aed6622f1` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.756299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a24f9923a847a4bb3f677aed6622f1)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.758356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.842641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1087/2126] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:11 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:11.847623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.858024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d520-573e-4b0d-84ea-5b3e5bd43459 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.862836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.864805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.865094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.865373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.866150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.867760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.881171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1088/2127] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:11.882218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.884914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a24f9923a847a4bb3f677aed6622f1', 'request_id': 'req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.892786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9d51-f336-4fe5-9c5c-0576b75c2d1d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.951742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.952472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.952757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.953610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.954353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:11.956003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:11.967437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1089/2128] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:11.972550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a24f9923a847a4bb3f677aed6622f1', 'request_id': 'req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.973272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:11.975975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a24f9923a847a4bb3f677aed6622f1', 'request_id': 'req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.977109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:11.983021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ea28-50b5-4f03-b59e-abbf71956256 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:11.989225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:11.989454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] The token cache is being invalidate because project 30a24f9923a847a4bb3f677aed6622f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:11.989454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.989641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:11.989641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:11.989907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] PATH_INFO: `/v3/projects/7636a8e7e9d94a59bcb1062e90d96328/users/055e0802c4e745d3ad5986b491d08519/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:11.990001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-336e63b7-13a5-44f3-b2a2-e57553ef8ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:11.991546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1040/2129] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:11 2022] DELETE /identity/v3/projects/30a24f9923a847a4bb3f677aed6622f1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:12.008962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7636a8e7e9d94a59bcb1062e90d96328, user_id=055e0802c4e745d3ad5986b491d08519, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.011919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.083935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1090/2130] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:11 2022] PUT /identity/v3/projects/7636a8e7e9d94a59bcb1062e90d96328/users/055e0802c4e745d3ad5986b491d08519/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:12.094830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.095348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.095864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.127253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] MFA Rules not processed for user `055e0802c4e745d3ad5986b491d08519`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:12.128592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:12.207398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1041/2131] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:12.212172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:12.214105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:12.281302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da46f4-e3c3-4181-af1e-605083495956 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:12.283775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:12.287830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:12.288497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.291584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.291584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.291584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.291913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.407193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1091/2132] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:12 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:12.408420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:12.425438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1056-6553-441b-bf98-8b4d3c9ef99a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:12.522189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:12.522895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.523236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.523565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.524315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.526558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.649901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1042/2133] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:12 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:12.654404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:12.666229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e50e-eae1-4add-b518-bfb1b18526b5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:12.671116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:12.672336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.672681 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.672959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.673759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.675337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.686728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1092/2134] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:12.691663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:12.702628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794d23f-0198-4457-b34b-fd8a7cef18b8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:12.707807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:12.708534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.708837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.709110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.709906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.711523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038a87-6f36-41e0-9a56-4d4353b6d1bd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.725454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1043/2135] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:12.729800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:12.741269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7787e-ae7d-4a5b-aa0d-64ae3c450569 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:12.746500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:12.747527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.747729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.748008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] PATH_INFO: `/v3/projects/cdb41753e6934cc9ba1d3e90bb5245e7/users/adb6805820e24f9b8df37cb476b9b5e7/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.765214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb41753e6934cc9ba1d3e90bb5245e7, user_id=adb6805820e24f9b8df37cb476b9b5e7, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:12.768640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:12.854815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1093/2136] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:12 2022] PUT /identity/v3/projects/cdb41753e6934cc9ba1d3e90bb5245e7/users/adb6805820e24f9b8df37cb476b9b5e7/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:12.866170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:12.866463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:12.866752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:12.897610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] MFA Rules not processed for user `adb6805820e24f9b8df37cb476b9b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:12.898898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:12.949690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:12.967636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1044/2137] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:12.972570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.038111 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b921b7-e96b-4459-b362-ac31b1a7d0c4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.047692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.048429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.048711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.048988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.049735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.051700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.164508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1094/2138] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:12 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:13.168569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.180672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39075-8605-4df3-b6df-4a2124f1aceb None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.247500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.248296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.250508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.250508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.250508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.252177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.368530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1045/2139] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:13 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:13.372567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.384078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9888f-0795-492f-99c8-4774323afabf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.388700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.389400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.389725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.400006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.400006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.400006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.403716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1095/2140] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:13.408098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.418690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579a592-6a55-4706-813d-097f3f2873a1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.424046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.424942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.425222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.425486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] PATH_INFO: `/v3/projects/c0efa058883848acb42ba3d5540a448c/users/84f8382e0d00431eb992f3baa4b01c38/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.446318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0efa058883848acb42ba3d5540a448c, user_id=84f8382e0d00431eb992f3baa4b01c38, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.449015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.619956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1046/2141] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:13 2022] PUT /identity/v3/projects/c0efa058883848acb42ba3d5540a448c/users/84f8382e0d00431eb992f3baa4b01c38/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:13.626535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.638071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d013-74f0-4a7a-8481-6ca07b90d621 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.738999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.740280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.740618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.741163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.741691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.743366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf4cb9-c79f-414c-8f58-0a3e5e151957 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.763130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1096/2142] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:13.778703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:13.791432 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bdcc1-6c4b-4cc4-9c8e-128472711f0d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:13.796753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:13.807363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.807363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.807363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] PATH_INFO: `/v3/projects/c0efa058883848acb42ba3d5540a448c/users/84f8382e0d00431eb992f3baa4b01c38/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.807363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0efa058883848acb42ba3d5540a448c, user_id=84f8382e0d00431eb992f3baa4b01c38, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:13.807363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:13.818198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1047/2143] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:13 2022] PUT /identity/v3/projects/c0efa058883848acb42ba3d5540a448c/users/84f8382e0d00431eb992f3baa4b01c38/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:13.835348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:13.835348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:13.835348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:13.858751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:13.862617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] MFA Rules not processed for user `84f8382e0d00431eb992f3baa4b01c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:13.863979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:13.947372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1097/2144] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:14.275729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:14.277788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:14.351843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e18c8-0332-4171-b0f4-e7209bd6c6e8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:14.355485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:14.356137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:14.356424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:14.356702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:14.366598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:14.368042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:14.378993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1048/2145] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:14.515801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:14.528957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cba37-af4d-459c-b075-a88d69eabc26 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:14.533489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:14.534161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:14.534443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:14.534715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:14.599575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:14.601230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38912251-ef9f-4952-9ea2-7b8b05c9f1dc service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:14.611802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1098/2146] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:19.912392 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:19.972068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:19.986669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e50f4-7a9f-434e-9d30-51f191e8b895 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:19.991239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:19.992110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:19.992395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:19.992670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] PATH_INFO: `/v3/users/055e0802c4e745d3ad5986b491d08519` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:19.993891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055e0802c4e745d3ad5986b491d08519)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:19.995820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:20.216491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055e0802c4e745d3ad5986b491d08519'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:20.217101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055e0802c4e745d3ad5986b491d08519'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:20.217741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055e0802c4e745d3ad5986b491d08519'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:20.224807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055e0802c4e745d3ad5986b491d08519'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:20.292439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055e0802c4e745d3ad5986b491d08519'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:20.317166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1049/2147] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:19 2022] DELETE /identity/v3/users/055e0802c4e745d3ad5986b491d08519 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:20.321914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:20.322407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:20.322506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:20.341114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:20.342369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:20.404911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1099/2148] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:20.414935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:20.416406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:20.475980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eed-810e-41e2-9348-5d9435268945 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:20.479538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:20.480545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:20.480545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:20.480741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:20.490653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:20.492086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:20.501596 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1050/2149] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:20.940545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:20.944330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:20.962042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a2024-4aeb-4474-a57c-cea4f23cad5d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:20.968503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:20.969598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:20.970066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:20.970347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] PATH_INFO: `/v3/projects/7636a8e7e9d94a59bcb1062e90d96328` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:20.972462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7636a8e7e9d94a59bcb1062e90d96328)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:20.975008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:21.109485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:21.122442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7636a8e7e9d94a59bcb1062e90d96328', 'request_id': 'req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.128355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7636a8e7e9d94a59bcb1062e90d96328', 'request_id': 'req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.208078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7636a8e7e9d94a59bcb1062e90d96328', 'request_id': 'req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.220423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] The token cache is being invalidate because project 7636a8e7e9d94a59bcb1062e90d96328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:21.221261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.222234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.223793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1100/2150] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:20 2022] DELETE /identity/v3/projects/7636a8e7e9d94a59bcb1062e90d96328 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:21.227870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:21.238915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c41a77-55b0-4d8b-9ca3-013d150b24cf service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:21.300606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:21.301509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:21.301828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:21.302113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] PATH_INFO: `/v3/users/adb6805820e24f9b8df37cb476b9b5e7` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:21.303367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb6805820e24f9b8df37cb476b9b5e7)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:21.305326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:21.317247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:21.531857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb6805820e24f9b8df37cb476b9b5e7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.532519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb6805820e24f9b8df37cb476b9b5e7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.533162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb6805820e24f9b8df37cb476b9b5e7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.542699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb6805820e24f9b8df37cb476b9b5e7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.653770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb6805820e24f9b8df37cb476b9b5e7'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:21.672204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1051/2151] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:21 2022] DELETE /identity/v3/users/adb6805820e24f9b8df37cb476b9b5e7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:22.160400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:22.160400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:22.178443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a44e-49b7-4449-a7ee-c9ac8fb8016d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:22.258500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:22.259479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:22.259831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:22.260119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] PATH_INFO: `/v3/projects/cdb41753e6934cc9ba1d3e90bb5245e7` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:22.261429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb41753e6934cc9ba1d3e90bb5245e7)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:22.263419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:22.396501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb41753e6934cc9ba1d3e90bb5245e7', 'request_id': 'req-69a9ffeb-95d4-4921-85be-ae501424e2e9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.402351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb41753e6934cc9ba1d3e90bb5245e7', 'request_id': 'req-69a9ffeb-95d4-4921-85be-ae501424e2e9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.481893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb41753e6934cc9ba1d3e90bb5245e7', 'request_id': 'req-69a9ffeb-95d4-4921-85be-ae501424e2e9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.494682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] The token cache is being invalidate because project cdb41753e6934cc9ba1d3e90bb5245e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:22.494975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.495628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.497168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1101/2152] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:22 2022] DELETE /identity/v3/projects/cdb41753e6934cc9ba1d3e90bb5245e7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:22.501365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:22.502911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:22.516100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3458ca-ac0d-4d86-a272-5b59f486b07e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:22.582563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:22.583398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:22.583798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:22.584103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] PATH_INFO: `/v3/users/84f8382e0d00431eb992f3baa4b01c38` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:22.585377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f8382e0d00431eb992f3baa4b01c38)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:22.587361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:22.771272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f8382e0d00431eb992f3baa4b01c38'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.773400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f8382e0d00431eb992f3baa4b01c38'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.773400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f8382e0d00431eb992f3baa4b01c38'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.780041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f8382e0d00431eb992f3baa4b01c38'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.859407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-eed58666-05ed-4588-96bb-051afffbaae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f8382e0d00431eb992f3baa4b01c38'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:22.878374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1052/2153] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:22 2022] DELETE /identity/v3/users/84f8382e0d00431eb992f3baa4b01c38 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:23.296345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:23.301722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:23.330121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9ffeb-95d4-4921-85be-ae501424e2e9 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:23.397387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:23.415739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:23.416616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:23.416897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:23.417198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] PATH_INFO: `/v3/projects/c0efa058883848acb42ba3d5540a448c` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:23.421041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0efa058883848acb42ba3d5540a448c)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:23.421041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:23.561608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0efa058883848acb42ba3d5540a448c', 'request_id': 'req-be479b8b-386c-4f93-ad04-aec12d22bab4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:23.582860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0efa058883848acb42ba3d5540a448c', 'request_id': 'req-be479b8b-386c-4f93-ad04-aec12d22bab4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:23.663412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0efa058883848acb42ba3d5540a448c', 'request_id': 'req-be479b8b-386c-4f93-ad04-aec12d22bab4'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:23.666409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] The token cache is being invalidate because project c0efa058883848acb42ba3d5540a448c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:23.666758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:23.667421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-be479b8b-386c-4f93-ad04-aec12d22bab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:23.668998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1102/2154] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:23 2022] DELETE /identity/v3/projects/c0efa058883848acb42ba3d5540a448c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:23.675898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:23.676595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:23.676595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:23.689680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:23.698175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:23.699429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:23.765897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1053/2155] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:23.774722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:23.778331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:23.778331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:23.795463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:23.796701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:23.810249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1103/2156] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:23.814771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:23.825598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe56089-a481-41d5-aaa3-b8c2101e2207 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:23.830516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:23.831225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:23.831504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:23.831779 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:23.832537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:23.832872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:23.834509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:23.846140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1054/2157] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:23.853790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:23.864323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195976e-7de1-499f-9e12-f199864ae8ea None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:23.869349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:23.869997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:23.870288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:23.870567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:23.871280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:23.873272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:23.960116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1104/2158] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:23 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:23.964494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:23.983738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf964-9d0b-4678-afcb-7c44bd9ffb4c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.085076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.086320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.086883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.087400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.088662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.092401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.182730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1055/2159] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:23 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:24.186033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.199663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2460e-4be1-44e6-b5d2-eb1953488320 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.204471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.205337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.205662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.206800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.207557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.209220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.220719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1105/2160] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:24.225048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.235710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1355f6-102c-4958-ac61-92a3efcb4f3f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.241425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.242242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.242553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.242858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.243591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.245218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64e564-25aa-4206-94ce-bf2e5e8b79dd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.256478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1056/2161] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:24.260979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.272813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa9439-c24a-4799-bcf2-ae08c544cd03 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.279161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.280925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.281433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.281979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] PATH_INFO: `/v3/projects/b177ac1b1d144405b9a2c020a6a436a3/users/5f07b6f1395c461eb53b4400c75d92a4/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.308545 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b177ac1b1d144405b9a2c020a6a436a3, user_id=5f07b6f1395c461eb53b4400c75d92a4, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.313999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.413369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1106/2162] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:24 2022] PUT /identity/v3/projects/b177ac1b1d144405b9a2c020a6a436a3/users/5f07b6f1395c461eb53b4400c75d92a4/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:24.426045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.426231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.426495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.455383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] MFA Rules not processed for user `5f07b6f1395c461eb53b4400c75d92a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:24.456955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:24.531459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1057/2163] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:24.536263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.626119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25fd5a-19f7-4812-8a95-175b5f158a7e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.631792 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.632461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.633466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.633466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.633732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.635652 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.781634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1107/2164] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:24 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:24.786416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.791986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:24.797824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dd77-ec3d-4f47-9778-2c8620883e4e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.854503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.855182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.855466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.855743 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.856441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.858509 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.952718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1058/2165] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:24 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:24.954045 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:24.961879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:24.972154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f238-5516-4c80-8bae-f606bd62c4fa admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:24.974018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:24.974709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:24.974999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:24.975281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:24.976024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:24.977714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:24.989694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1108/2166] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:24.993752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.004250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9533a-ad11-480e-8eb1-0343268f22c7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.011943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.018720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.018720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.018720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] PATH_INFO: `/v3/projects/c9895d8642064489ada0ec23f3b22796/users/9cbe56d30d034b1392e08c6955a550d8/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.030925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9895d8642064489ada0ec23f3b22796, user_id=9cbe56d30d034b1392e08c6955a550d8, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.033603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.039739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.041494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.054685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96e4a2-96f8-4cd6-bcfc-311ca50122d5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.060046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.060917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.063352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.063352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] PATH_INFO: `/v3/users/5fae4bb09baf43088c1ec3a3715f18a3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.063352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fae4bb09baf43088c1ec3a3715f18a3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.064654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.169324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1059/2167] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:24 2022] PUT /identity/v3/projects/c9895d8642064489ada0ec23f3b22796/users/9cbe56d30d034b1392e08c6955a550d8/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:25.173244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.244820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef837d-29c8-4f3a-8290-6f2178d158e0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.249587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.250271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.250564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.250846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.251584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.253377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.263534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1060/2168] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:25.267763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.278943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf547-7402-47e4-85bf-1975c8c067cf admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.283706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.285195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.285478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.285773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] PATH_INFO: `/v3/projects/c9895d8642064489ada0ec23f3b22796/users/9cbe56d30d034b1392e08c6955a550d8/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.288099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9895d8642064489ada0ec23f3b22796, user_id=9cbe56d30d034b1392e08c6955a550d8, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.291144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843d34c-dc59-4879-994e-43297a930621 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.302299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1061/2169] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:25 2022] PUT /identity/v3/projects/c9895d8642064489ada0ec23f3b22796/users/9cbe56d30d034b1392e08c6955a550d8/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:25.313629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9452fe-4a35-443b-93bd-adc6045bd46e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.313924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9452fe-4a35-443b-93bd-adc6045bd46e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.314207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9452fe-4a35-443b-93bd-adc6045bd46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.315029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fae4bb09baf43088c1ec3a3715f18a3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:25.329537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fae4bb09baf43088c1ec3a3715f18a3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:25.330299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fae4bb09baf43088c1ec3a3715f18a3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:25.331672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fae4bb09baf43088c1ec3a3715f18a3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:25.338957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fae4bb09baf43088c1ec3a3715f18a3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:25.341950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1b9452fe-4a35-443b-93bd-adc6045bd46e None None] MFA Rules not processed for user `9cbe56d30d034b1392e08c6955a550d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:25.343422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1b9452fe-4a35-443b-93bd-adc6045bd46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.385893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:25.413924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1109/2170] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:25 2022] DELETE /identity/v3/users/5fae4bb09baf43088c1ec3a3715f18a3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:25.417128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1062/2171] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:25.418913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.419206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.419514 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.426176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.427587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.439778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:25.441840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.493675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103443-bbe8-4d0a-887f-6504694a5a54 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.497763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.498361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.498666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.498948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.506318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1063/2172] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:25.515814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.517172 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.569030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.570650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.577951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f457a5-7c36-4e9d-be81-c67c3e320982 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.582377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1110/2173] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:25.583116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.583821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.584118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.584404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.595614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.597140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.607757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1064/2174] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:25.805024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:25.813609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62edc65-571f-4023-ad85-4347d27ff09a service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:25.818049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:25.818687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:25.818973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:25.819253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:25.821029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:25.832730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:25.901603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:25.903460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45843-5e70-4aa3-b17c-205455822622 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:25.913784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1111/2175] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:26.208905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.210764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:26.226071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60db25-c64e-4558-98af-9b97bd55499b service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:26.231336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:26.232213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.232497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.238936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] PATH_INFO: `/v3/projects/f8d37c1f726e4ad4a36f3463359bfef3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.238936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d37c1f726e4ad4a36f3463359bfef3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:26.238936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:26.359957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d37c1f726e4ad4a36f3463359bfef3', 'request_id': 'req-9b24335c-5498-4454-996f-76adc3278352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:26.413398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d37c1f726e4ad4a36f3463359bfef3', 'request_id': 'req-9b24335c-5498-4454-996f-76adc3278352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:26.420749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d37c1f726e4ad4a36f3463359bfef3', 'request_id': 'req-9b24335c-5498-4454-996f-76adc3278352'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:26.434007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] The token cache is being invalidate because project f8d37c1f726e4ad4a36f3463359bfef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:26.434297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:26.435081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9b24335c-5498-4454-996f-76adc3278352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:26.436673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1065/2176] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:26 2022] DELETE /identity/v3/projects/f8d37c1f726e4ad4a36f3463359bfef3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:26.443018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.443555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.443713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.463290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:26.464688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:26.549907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1112/2177] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:26.557517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.557770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.558054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.566116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:26.579818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:26.581319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:26.593839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1066/2178] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:26.596431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.607391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa90ef-ec3e-438c-a775-19789f4376d5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:26.613870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:26.614558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.614847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.615131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.615875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:26.616194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:26.617876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:26.637506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1113/2179] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:26.638496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.652384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baf7f1-1c08-4ac8-a149-c107452398ad None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:26.657687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:26.658404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.658966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.658966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.659686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:26.661631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:26.738305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1067/2180] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:26.743437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.757138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3733-2999-4b38-9ef4-1f86b7fe6704 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:26.829803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:26.830534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.830999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.833021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.833021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:26.834287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:26.933112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1114/2181] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:26 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:26.937287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.948020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fde5b-0f78-4751-90ef-e41f8b2ab826 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:26.952769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:26.953513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:26.953786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:26.954079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:26.954812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:26.956664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:26.968215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1068/2182] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:26.973205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:26.997843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d12a9-4ad8-4dc4-a5f6-d15dfe17d90a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:27.005149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:27.005877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.006162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.006638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.007384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:27.009195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:27.023913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1115/2183] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:27.025456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:27.037254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ecf05-5010-4f12-b97c-9ed593ec6143 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:27.042317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:27.043258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.043540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.043809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] PATH_INFO: `/v3/projects/d87218cb76a7401cafa202af3747810a/users/c92e70e48fa94e4dbf53532439d6efe3/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.066363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87218cb76a7401cafa202af3747810a, user_id=c92e70e48fa94e4dbf53532439d6efe3, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:27.066363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390737-43ca-424f-873e-70587f93672a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:27.125689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:27.128266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:27.138823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1069/2184] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:27 2022] PUT /identity/v3/projects/d87218cb76a7401cafa202af3747810a/users/c92e70e48fa94e4dbf53532439d6efe3/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:27.145198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94905ad-46fb-4aea-a2f0-f9f0ab47b634 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:27.151417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.151792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.152405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.166188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:27.180523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] MFA Rules not processed for user `c92e70e48fa94e4dbf53532439d6efe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:27.181799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:27.212334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:27.213229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.213543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.213859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] PATH_INFO: `/v3/users/9fd81e9490e848ac9d2de49116be6364` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.215066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd81e9490e848ac9d2de49116be6364)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:27.217152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:27.248301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1070/2185] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:27.259840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:27.261227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:27.334487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d756f9-674c-4218-a8b3-7d2732d6675f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:27.336142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:27.336895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.337178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.337728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.347428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:27.349062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23bfc3-1128-4b2c-afd2-c9484681168e service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:27.358184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1071/2186] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:27.425461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd81e9490e848ac9d2de49116be6364'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:27.439029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd81e9490e848ac9d2de49116be6364'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:27.440258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd81e9490e848ac9d2de49116be6364'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:27.441048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd81e9490e848ac9d2de49116be6364'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:27.448076 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd81e9490e848ac9d2de49116be6364'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:27.560738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1116/2187] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:27 2022] DELETE /identity/v3/users/9fd81e9490e848ac9d2de49116be6364 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:27.567890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.568176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.568448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.586193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:27.587333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:27.615010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:27.650523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1072/2188] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:27.660807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:27.662447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:27.731350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05062c-3606-463c-82eb-b1510454a0c8 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:27.735658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:27.736067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:27.736410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:27.736763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:27.747993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:27.749943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f1ca-98e6-4941-96af-cd2558d06fa9 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:27.761914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1117/2189] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:28.239118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:28.241360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:28.257289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100539e-45f8-498c-ba12-6363b25a0f15 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:28.270651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:28.270651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.270953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.271352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] PATH_INFO: `/v3/projects/9317ef7adbb94ce2af68daacd756a87c` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.272454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9317ef7adbb94ce2af68daacd756a87c)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:28.274435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:28.420137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9317ef7adbb94ce2af68daacd756a87c', 'request_id': 'req-b6db047c-5ac6-42e5-b891-998fd7e09389'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:28.499353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9317ef7adbb94ce2af68daacd756a87c', 'request_id': 'req-b6db047c-5ac6-42e5-b891-998fd7e09389'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:28.507277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9317ef7adbb94ce2af68daacd756a87c', 'request_id': 'req-b6db047c-5ac6-42e5-b891-998fd7e09389'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:28.519279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] The token cache is being invalidate because project 9317ef7adbb94ce2af68daacd756a87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:28.519561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:28.520225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b6db047c-5ac6-42e5-b891-998fd7e09389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:28.523087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1073/2190] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:28 2022] DELETE /identity/v3/projects/9317ef7adbb94ce2af68daacd756a87c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:28.528150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.529483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.529483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.546915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:28.548126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:28.598893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:28.613282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1118/2191] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:28.621218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.621511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.621826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.641998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:28.643903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:28.651852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1074/2192] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:28.656402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:28.668688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509b3b-d2bd-4057-a3c4-4f58e173bdf9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:28.670435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:28.671085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.671366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.671641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.672360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:28.672665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:28.674372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:28.685737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1119/2193] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:28.690867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:28.700362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0420-0f76-472e-9c11-67524e610c8c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:28.705466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:28.706865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.707152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.707431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.708127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:28.710112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:28.827199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1075/2194] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:28 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:28.832487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:28.846817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3b44-29d8-42ec-b5a8-647acbdafd2f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:28.906547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:28.907148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:28.907467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:28.907753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:28.908461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:28.910482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.020229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1120/2195] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:28 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:29.024296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.035385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06116f64-4962-42c5-9c7a-beac58e78ae9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.040257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.041069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.041352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.041668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.042511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.044110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.056670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1076/2196] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:29.060774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.072066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baba44-75e1-4f45-bb56-0c5e7f8de520 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.078373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.079037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.079319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.079596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.080323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.082411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768a1d8-cec5-4b63-92e0-3e17fd12d3dc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.092916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1121/2197] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:29.098087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.108605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adbccf-f1a4-4bc7-9976-6cf579b9e150 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.113980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.114932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.115242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.115518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] PATH_INFO: `/v3/projects/c4ff2f14a35c4cfa957d2ea921122c8c/users/fa1a538bc9324407aaba20ef1f197236/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.134014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ff2f14a35c4cfa957d2ea921122c8c, user_id=fa1a538bc9324407aaba20ef1f197236, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.145785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.239126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1077/2198] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:29 2022] PUT /identity/v3/projects/c4ff2f14a35c4cfa957d2ea921122c8c/users/fa1a538bc9324407aaba20ef1f197236/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:29.249297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.249608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.249888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.279171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] MFA Rules not processed for user `fa1a538bc9324407aaba20ef1f197236`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:29.280723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:29.358502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1122/2199] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:29.363613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.420111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:29.432563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af9da-af97-477f-a285-ecf684c5ee3d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.437428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.438125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.438413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.438820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.439507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.441530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.546351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1078/2200] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:29 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:29.551573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.564023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e113b1-1fe8-4907-9c70-158731f4d0d9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.600484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:29.628191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.629425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.629779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.630144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.630797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.633400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.761466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1123/2201] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:29 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:29.766247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.781275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747a84-1d8b-42c8-b62a-afe794704cbc admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.786915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.787592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.787878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.788158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.788998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.790632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.802428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1079/2202] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:29.806659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.817900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4141-4e8f-4704-bdaf-dbd0c82b9fca admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.822675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.823350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.823636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.823916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.824659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.826352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecd83-f304-4255-9894-e708fc0ca5c6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.836927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1124/2203] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:29.844874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:29.856444 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4c0a-be47-4aa7-8171-7dcba8b708ee admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:29.861629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:29.863695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.864081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.870731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] PATH_INFO: `/v3/projects/bb954603f9d1464eac1998f48e377d00/users/cc2c2386847d45b98658f62f2d7417e2/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:29.881773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb954603f9d1464eac1998f48e377d00, user_id=cc2c2386847d45b98658f62f2d7417e2, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:29.884472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:29.975303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1080/2204] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:29 2022] PUT /identity/v3/projects/bb954603f9d1464eac1998f48e377d00/users/cc2c2386847d45b98658f62f2d7417e2/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:29.986605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:29.986977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:29.987756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.016333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] MFA Rules not processed for user `cc2c2386847d45b98658f62f2d7417e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:30.017554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:30.105377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1125/2205] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:30.110132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.191944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbb1d0-55bc-4d72-a044-afdc85f9241d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.203543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.204234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.204522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.204802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.205501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.207997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.314765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1081/2206] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:30 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:30.319427 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.338676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653ce89-0adc-4990-9527-cc8cadda3b8a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.400716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.401457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.401671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.402305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.403063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.405216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.484525 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1126/2207] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:30 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:30.492524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.503218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee894c-e06c-411a-8aa9-7e1c36e4f11b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.508231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.509019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.509235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.509513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.517349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.517349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.524197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1082/2208] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:30.528620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.540913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e921f-d411-4191-9af8-5761f1af5f79 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.545797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.546690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.546972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.547253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] PATH_INFO: `/v3/projects/7fd7daa79a044d7cb1760f5506091be0/users/c514cd5bb92d4cf9b5f54da5f7be3adb/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.563485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd7daa79a044d7cb1760f5506091be0, user_id=c514cd5bb92d4cf9b5f54da5f7be3adb, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.567522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.705251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1127/2209] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:30 2022] PUT /identity/v3/projects/7fd7daa79a044d7cb1760f5506091be0/users/c514cd5bb92d4cf9b5f54da5f7be3adb/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:30.710373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.725114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6316c5c-76b9-4e75-9ac7-e98adacab8e4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.782217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.782801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.783085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.783621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.784344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.785983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a686412-e2fc-4fa7-8705-3b36aab315db admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.796018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1083/2210] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:30.800656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.810986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2ab8-6614-4646-9246-bdb313148293 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:30.816911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:30.817859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.818172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.818451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] PATH_INFO: `/v3/projects/7fd7daa79a044d7cb1760f5506091be0/users/c514cd5bb92d4cf9b5f54da5f7be3adb/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.820482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd7daa79a044d7cb1760f5506091be0, user_id=c514cd5bb92d4cf9b5f54da5f7be3adb, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:30.823260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:30.827470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:30.842300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1128/2211] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:30 2022] PUT /identity/v3/projects/7fd7daa79a044d7cb1760f5506091be0/users/c514cd5bb92d4cf9b5f54da5f7be3adb/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:30.855639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c103-bde3-4386-a304-6fafded1752b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:30.856108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c103-bde3-4386-a304-6fafded1752b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:30.856443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c103-bde3-4386-a304-6fafded1752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:30.879076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:30.888941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f494c103-bde3-4386-a304-6fafded1752b None None] MFA Rules not processed for user `c514cd5bb92d4cf9b5f54da5f7be3adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:30.890246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f494c103-bde3-4386-a304-6fafded1752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:30.966347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1084/2212] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:30.990709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:30.990709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:31.048441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d6c46-87fb-42f8-a4c7-d8bf40a57d8e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:31.053766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:31.054606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:31.054686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:31.054948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:31.121343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:31.122914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917db321-9635-4916-8ce8-7ab725ced7ce service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:31.133193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1129/2213] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:32.854523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c103-bde3-4386-a304-6fafded1752b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:32.858491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f494c103-bde3-4386-a304-6fafded1752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:32.943287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c103-bde3-4386-a304-6fafded1752b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:32.946674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:32.947565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:32.947884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:32.948166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] PATH_INFO: `/v3/users/5f07b6f1395c461eb53b4400c75d92a4` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:32.949469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f07b6f1395c461eb53b4400c75d92a4)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:32.951522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:33.178148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f07b6f1395c461eb53b4400c75d92a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:33.178823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f07b6f1395c461eb53b4400c75d92a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:33.179437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f07b6f1395c461eb53b4400c75d92a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:33.186989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f07b6f1395c461eb53b4400c75d92a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:33.286818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f07b6f1395c461eb53b4400c75d92a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:33.309993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1085/2214] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:32 2022] DELETE /identity/v3/users/5f07b6f1395c461eb53b4400c75d92a4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:33.314257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:33.314819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:33.314819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:33.332940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:33.334179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:33.398737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1130/2215] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:33.408878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:33.410924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:33.430551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:33.488186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17bbbb-7897-42a3-849c-d96b7c6ecce4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:33.492327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:33.493043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:33.493995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:33.494275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:33.506066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:33.512842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:33.529756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1086/2216] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:34.110476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:34.114364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:34.141144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ea8dc-e4d3-4292-89ec-0cadc33c9105 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:34.150263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:34.151870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:34.155570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:34.155570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] PATH_INFO: `/v3/projects/b177ac1b1d144405b9a2c020a6a436a3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:34.155570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b177ac1b1d144405b9a2c020a6a436a3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:34.157644 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:34.224436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:34.226528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:34.275332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:34.278552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b177ac1b1d144405b9a2c020a6a436a3', 'request_id': 'req-dc7850fe-fa3e-4929-a435-ed8934467e29'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.284878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b177ac1b1d144405b9a2c020a6a436a3', 'request_id': 'req-dc7850fe-fa3e-4929-a435-ed8934467e29'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.297152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c3899-010f-4077-b880-66bfdf60f1db service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:34.356287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b177ac1b1d144405b9a2c020a6a436a3', 'request_id': 'req-dc7850fe-fa3e-4929-a435-ed8934467e29'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.356765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:34.357047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:34.357334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:34.357652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:34.360767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:34.369442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] The token cache is being invalidate because project b177ac1b1d144405b9a2c020a6a436a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:34.369846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.370587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.372197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1131/2217] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:34 2022] DELETE /identity/v3/projects/b177ac1b1d144405b9a2c020a6a436a3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:34.376229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:34.378136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:34.424694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:34.426371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:34.435637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1087/2218] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:34.449313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7850fe-fa3e-4929-a435-ed8934467e29 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:34.454274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:34.458446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:34.458446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:34.458446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] PATH_INFO: `/v3/users/9cbe56d30d034b1392e08c6955a550d8` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:34.458446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbe56d30d034b1392e08c6955a550d8)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:34.460084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:34.653591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbe56d30d034b1392e08c6955a550d8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.660004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbe56d30d034b1392e08c6955a550d8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.660746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbe56d30d034b1392e08c6955a550d8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.661379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbe56d30d034b1392e08c6955a550d8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.668601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbe56d30d034b1392e08c6955a550d8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:34.762027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1132/2219] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:34 2022] DELETE /identity/v3/users/9cbe56d30d034b1392e08c6955a550d8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:34.834853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:34.836270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:34.850041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb86b-c64f-4e00-8cf6-79bfa6c0efe2 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:34.877319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:34.929231 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:34.930328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:34.930609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:34.931031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] PATH_INFO: `/v3/users/c92e70e48fa94e4dbf53532439d6efe3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:34.932343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92e70e48fa94e4dbf53532439d6efe3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:34.935152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.114476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92e70e48fa94e4dbf53532439d6efe3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.115115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92e70e48fa94e4dbf53532439d6efe3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.115800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92e70e48fa94e4dbf53532439d6efe3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.124423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92e70e48fa94e4dbf53532439d6efe3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.165489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.167890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.195893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856056b-57d1-4260-a50d-2cfe3c35e478 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.204358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.207182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.207394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.207934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] PATH_INFO: `/v3/projects/c9895d8642064489ada0ec23f3b22796` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.210155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9895d8642064489ada0ec23f3b22796)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:35.213978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.223830 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b169e48d-0cff-4381-b630-e85f8bc8bbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92e70e48fa94e4dbf53532439d6efe3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.242571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1088/2220] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:34 2022] DELETE /identity/v3/users/c92e70e48fa94e4dbf53532439d6efe3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:35.247073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.247370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.247652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.271609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:35.273201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.339766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:35.341218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9895d8642064489ada0ec23f3b22796', 'request_id': 'req-994a842e-bff4-4403-bd9b-b9c86007b9dd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.345248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1089/2221] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:35.347773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9895d8642064489ada0ec23f3b22796', 'request_id': 'req-994a842e-bff4-4403-bd9b-b9c86007b9dd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.355192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.356552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.412088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:35.415762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d647855-fdaa-4df3-9f9b-ea626350c623 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.471512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.472144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.472438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.472718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.486671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9895d8642064489ada0ec23f3b22796', 'request_id': 'req-994a842e-bff4-4403-bd9b-b9c86007b9dd'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.500945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] The token cache is being invalidate because project c9895d8642064489ada0ec23f3b22796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:35.500945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.501771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-994a842e-bff4-4403-bd9b-b9c86007b9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:35.504397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1133/2222] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:35 2022] DELETE /identity/v3/projects/c9895d8642064489ada0ec23f3b22796 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:35.509313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f7994-0f34-4c8a-b694-ce6fa79d86f6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.509862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f7994-0f34-4c8a-b694-ce6fa79d86f6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.510333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f7994-0f34-4c8a-b694-ce6fa79d86f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.532301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6d6f7994-0f34-4c8a-b694-ce6fa79d86f6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:35.533874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6d6f7994-0f34-4c8a-b694-ce6fa79d86f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.543532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1134/2223] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:35.547370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:35.553593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.553795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.553795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.553795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.579878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:35.581445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.585622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1090/2224] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:35.595301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1135/2225] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:35.599952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.601411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.615940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64eb-6991-49c5-8b03-33f6fef1d366 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.619910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.620576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.620865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.621266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.622136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:35.622445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:35.624051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.638623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1091/2226] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:35.643099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.654616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366161-e240-4ce0-9d27-25e9b7972053 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.662435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.663332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.664282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.664669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.665529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:35.667612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.765412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1136/2227] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:35 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:35.769581 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.786461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4ae3-a35c-480f-9370-d208c34369af admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.913953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:35.917455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:35.926147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.931122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.931122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.931122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.931122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:35.931122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:35.984614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f157f3-4954-4f85-bc6b-7af31a6167ae admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:35.990249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:35.991010 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:35.991257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:35.992038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:35.994060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.029124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1092/2228] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:35 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:36.033021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.044234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c095-dcf2-43bf-94fb-d33ef95d2308 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.049390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.050794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.051166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.051449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.052216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.053859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.064141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1093/2229] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:36.071190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.080186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.081027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cd462-a478-4123-a222-273f6ab3fa12 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.081760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.085842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.086515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.086805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.087084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.088018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.089648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.092000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1137/2230] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:36.102256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1094/2231] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:36.106524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.117817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a98d6-33f2-4615-bbcc-6a75fe816818 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.123024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.123917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.124197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.124467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] PATH_INFO: `/v3/projects/916d8f1e79854f889c64e4ad170d98df/users/ab481c39f1f343448c806f0e1ad57678/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.139474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916d8f1e79854f889c64e4ad170d98df, user_id=ab481c39f1f343448c806f0e1ad57678, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.143261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e2cb-403c-4c13-88d1-b36faeaf27e2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.169798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.172252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.189788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e3b1-b0b3-4ee1-a0e6-7b51fd4fd0ca admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.199091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.200006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.200294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.200568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] PATH_INFO: `/v3/projects/d87218cb76a7401cafa202af3747810a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.202788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87218cb76a7401cafa202af3747810a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.204786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.232531 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:36.237976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1138/2232] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:36 2022] PUT /identity/v3/projects/916d8f1e79854f889c64e4ad170d98df/users/ab481c39f1f343448c806f0e1ad57678/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:36.249003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.249296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.249601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.280059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] MFA Rules not processed for user `ab481c39f1f343448c806f0e1ad57678`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:36.281393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.295179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:36.324368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87218cb76a7401cafa202af3747810a', 'request_id': 'req-7764e362-6aad-4c81-87f9-7541c6495c54'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.351643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1139/2233] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:36.367915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.412844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87218cb76a7401cafa202af3747810a', 'request_id': 'req-7764e362-6aad-4c81-87f9-7541c6495c54'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.419316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87218cb76a7401cafa202af3747810a', 'request_id': 'req-7764e362-6aad-4c81-87f9-7541c6495c54'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.421367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8003-df3b-40bd-bebd-94310e8c9d29 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.430400 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] The token cache is being invalidate because project d87218cb76a7401cafa202af3747810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:36.430685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.431349 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-7764e362-6aad-4c81-87f9-7541c6495c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.432947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1095/2234] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:36 2022] DELETE /identity/v3/projects/d87218cb76a7401cafa202af3747810a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:36.437676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061321-8165-4526-987a-b94d1e1e8f19 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.437965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061321-8165-4526-987a-b94d1e1e8f19 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.438243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061321-8165-4526-987a-b94d1e1e8f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.458140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c3061321-8165-4526-987a-b94d1e1e8f19 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:36.459448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c3061321-8165-4526-987a-b94d1e1e8f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.473170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.473881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.474315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.474603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.476541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.538400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.539865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.543429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1096/2235] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:36.549292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1140/2236] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:36.552326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380176-382f-49e5-827a-fac131b73d6d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.552621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380176-382f-49e5-827a-fac131b73d6d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.552907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380176-382f-49e5-827a-fac131b73d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.571580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-88380176-382f-49e5-827a-fac131b73d6d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:36.572805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-88380176-382f-49e5-827a-fac131b73d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.573697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.575071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.582106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1097/2237] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:36.586282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380176-382f-49e5-827a-fac131b73d6d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.589516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909498c3-c447-47e5-b2ec-d3095326f65e service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.602436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.602644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380176-382f-49e5-827a-fac131b73d6d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.602803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.602803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.602803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] PATH_INFO: `/v3/users/ab481c39f1f343448c806f0e1ad57678` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.602803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab481c39f1f343448c806f0e1ad57678)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.602803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.603236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.603236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.603236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.603236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.605886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:36.606530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.608683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.623927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1098/2238] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:24:36.629455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.640738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae5d80-83c0-4f98-9c15-34319b7f7493 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.646649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.647323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.647611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.647890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.648583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.650564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.682316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:36.713878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1099/2239] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:36.717996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.745819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab481c39f1f343448c806f0e1ad57678'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.759759 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab481c39f1f343448c806f0e1ad57678'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.760485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab481c39f1f343448c806f0e1ad57678'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.761125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab481c39f1f343448c806f0e1ad57678'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.768796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-09545f21-ceea-4c59-9f13-3bb57b372eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab481c39f1f343448c806f0e1ad57678'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:36.778784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:36.791000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ea561-89f1-4a96-b973-fceaa85d7d70 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.796510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.797209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.797505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.797824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.798518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.800843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.853944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1141/2240] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:36 2022] DELETE /identity/v3/users/ab481c39f1f343448c806f0e1ad57678 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:36.858371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.858773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.859135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.879510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:36.880767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.888693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1100/2241] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:36.890131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.891978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.908396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8374f-3b28-4dd3-a419-6e99dbcc67f0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:36.955282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1142/2242] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:36.960422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:36.961973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:36.977861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:36.978544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:36.978849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:36.979135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:36.979906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:36.981510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:36.993410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1101/2243] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:36.997316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:37.008370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc8b5-4c49-42f6-8089-613f3e97b4d9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.014017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.014549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.014834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.015111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.015846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.017446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:37.026749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b9533-b654-4fa3-8250-a470ca4ec64d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.028593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1102/2244] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:24:37.032701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:37.034478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.035135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.035420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.035699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.048351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.050378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad95888-dd4b-4aef-a403-269d4028f648 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.050528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9f4f-8c84-4fc4-b335-a97303ac0c91 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:37.059123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.059123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.059338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.059458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] PATH_INFO: `/v3/projects/090a9693a6f74a0299837f6cc3432718/users/763b64aa4bc54c3f950f3766802ec1d7/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.065718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1143/2245] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:24:37.079426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090a9693a6f74a0299837f6cc3432718, user_id=763b64aa4bc54c3f950f3766802ec1d7, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.083579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:37.165440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1103/2246] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:37 2022] PUT /identity/v3/projects/090a9693a6f74a0299837f6cc3432718/users/763b64aa4bc54c3f950f3766802ec1d7/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:37.176571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.176872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.177216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.223028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] MFA Rules not processed for user `763b64aa4bc54c3f950f3766802ec1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:37.224190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:37.257342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:37.327451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1144/2247] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:37.338828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:37.341290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:37.421510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b8e24-8a6c-4b06-bc7e-d68d83dc6b50 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.427258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.427686 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.428243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.428735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.439076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.441428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593818-afa5-4ead-acf2-68e767763d67 service glance] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:37.451756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1104/2248] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:37.529957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:37.531750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:37.619929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23998a5a-9593-48b8-974d-bffa2618ab96 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.625205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.626141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.626462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.626832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] PATH_INFO: `/v3/projects/916d8f1e79854f889c64e4ad170d98df` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.629185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=916d8f1e79854f889c64e4ad170d98df)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.631185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:37.740798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916d8f1e79854f889c64e4ad170d98df', 'request_id': 'req-aeb74016-1c62-430b-a96d-0ecf803fe30a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:37.746361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916d8f1e79854f889c64e4ad170d98df', 'request_id': 'req-aeb74016-1c62-430b-a96d-0ecf803fe30a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:37.802804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916d8f1e79854f889c64e4ad170d98df', 'request_id': 'req-aeb74016-1c62-430b-a96d-0ecf803fe30a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:37.808986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] The token cache is being invalidate because project 916d8f1e79854f889c64e4ad170d98df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:37.809275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:37.809935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aeb74016-1c62-430b-a96d-0ecf803fe30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:37.811574 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1145/2249] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:37 2022] DELETE /identity/v3/projects/916d8f1e79854f889c64e4ad170d98df => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:37.818756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.819051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.819322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.838778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:37.839994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:37.888151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:37.912672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1105/2250] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:37.917341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.917658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.917937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.939450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:37.941402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:37.957705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1146/2251] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:37.966829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:37.980620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3b838-6cf4-4180-b9af-a0953258bb3d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:37.986298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:37.987614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:37.988123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:37.988367 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:37.989283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:37.989535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:37.991178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.006623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1106/2252] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:38.011192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.020577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b9c9c-7263-4f70-a7b4-2217123bf676 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.025371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.026068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.026354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.026629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.027571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.029473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.136471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1147/2253] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:38 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:38.140563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.152276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed54c1d-0af2-4659-9d6a-67646e7ad97d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.211723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.213143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.213143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.213143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.213758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.215682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.329060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1107/2254] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:38 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:38.334055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.348142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4a08-7ceb-4747-861d-5f4c181ece08 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.353522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.354319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.354703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.355200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.356027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.357856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.374193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1148/2255] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:38.385732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.388955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541b02-d03c-4ebd-a6f6-98c0c5551887 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.394407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.395091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.395379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.395657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.396541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.398282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958aee3-a375-47e4-a5aa-b647a88ec3af admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.422202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.427867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1108/2256] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:38.434122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6163227-77a7-44ff-850f-d69aad89f72a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.440231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.447882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.447882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.447882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] PATH_INFO: `/v3/projects/cc4d8cd69c9b45ec8655e45f81852453/users/658a9f9907684d668cf0e6675442a6d2/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.483331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4d8cd69c9b45ec8655e45f81852453, user_id=658a9f9907684d668cf0e6675442a6d2, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.483331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.556233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:38.563473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1149/2257] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:38 2022] PUT /identity/v3/projects/cc4d8cd69c9b45ec8655e45f81852453/users/658a9f9907684d668cf0e6675442a6d2/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:24:38.574440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.574695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.574980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.603507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] MFA Rules not processed for user `658a9f9907684d668cf0e6675442a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:38.604726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:38.671705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1109/2258] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:38.683378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:38.685237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:38.744701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786f566-0266-4284-80c1-b2f5ea9200cc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:38.748359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:38.749002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:38.749282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:38.749604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:38.758095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:38.759716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa4955-7158-4914-b2e4-e5fa48bf4e35 service glance] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:38.769323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1150/2259] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:41.130433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:41.132558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:41.183072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:41.206217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ac7d3-344f-41d3-be6a-bd0a2a74afdc None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:41.211162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:41.212123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:41.212404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:41.213064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] PATH_INFO: `/v3/users/fa1a538bc9324407aaba20ef1f197236` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:41.213941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1a538bc9324407aaba20ef1f197236)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:41.215886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:41.433882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1a538bc9324407aaba20ef1f197236'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:41.434461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1a538bc9324407aaba20ef1f197236'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:41.435073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1a538bc9324407aaba20ef1f197236'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:41.442605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1a538bc9324407aaba20ef1f197236'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:41.532263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1a538bc9324407aaba20ef1f197236'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:41.551864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1110/2260] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:41 2022] DELETE /identity/v3/users/fa1a538bc9324407aaba20ef1f197236 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:41.556434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:41.556974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:41.556974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:41.575136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:41.576365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:41.673626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1151/2261] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:41.681878 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:41.683391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:41.756167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e9dd-df4a-4f8d-bec7-0c1614431eaf admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:41.759756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:41.760471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:41.760740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:41.761015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:41.771754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:41.773218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:41.783394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1111/2262] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:42.415182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:42.417340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:42.435183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510df73-51ee-4d68-ae04-fb378c76bd22 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:42.441078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:42.442479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:42.442703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:42.442993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] PATH_INFO: `/v3/projects/c4ff2f14a35c4cfa957d2ea921122c8c` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:42.444237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ff2f14a35c4cfa957d2ea921122c8c)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:42.446288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:42.557284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ff2f14a35c4cfa957d2ea921122c8c', 'request_id': 'req-54a29d5c-5fe7-4562-971a-374f2118a513'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.563375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ff2f14a35c4cfa957d2ea921122c8c', 'request_id': 'req-54a29d5c-5fe7-4562-971a-374f2118a513'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.641098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ff2f14a35c4cfa957d2ea921122c8c', 'request_id': 'req-54a29d5c-5fe7-4562-971a-374f2118a513'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.654909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] The token cache is being invalidate because project c4ff2f14a35c4cfa957d2ea921122c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:42.655208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.655888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-54a29d5c-5fe7-4562-971a-374f2118a513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.657611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1152/2263] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:42 2022] DELETE /identity/v3/projects/c4ff2f14a35c4cfa957d2ea921122c8c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:42.662293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:42.672945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b308a3-4266-4c0a-a235-890f1d8f7474 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:42.741094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:42.749949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:42.749949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:42.749949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] PATH_INFO: `/v3/users/cc2c2386847d45b98658f62f2d7417e2` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:42.749949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2c2386847d45b98658f62f2d7417e2)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:42.749949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:42.751730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:42.927697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2c2386847d45b98658f62f2d7417e2'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.929249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2c2386847d45b98658f62f2d7417e2'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.929886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2c2386847d45b98658f62f2d7417e2'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:42.936946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2c2386847d45b98658f62f2d7417e2'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.013724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2c2386847d45b98658f62f2d7417e2'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.035216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1112/2264] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:42 2022] DELETE /identity/v3/users/cc2c2386847d45b98658f62f2d7417e2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:43.210178 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:43.210477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:43.210761 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:43.230093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] MFA Rules not processed for user `839cacebadc44567b6a818f762ec0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:43.234041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:43.250576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:43.293898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1153/2265] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:43.478804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:43.480440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:43.552277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5f03-30df-48f7-9831-aff84cdc515d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:43.556902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:43.558463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:43.558923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:43.559224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] PATH_INFO: `/v3/projects/bb954603f9d1464eac1998f48e377d00` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:43.560464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb954603f9d1464eac1998f48e377d00)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:43.563010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:43.689290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb954603f9d1464eac1998f48e377d00', 'request_id': 'req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.769002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb954603f9d1464eac1998f48e377d00', 'request_id': 'req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.776493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb954603f9d1464eac1998f48e377d00', 'request_id': 'req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.791141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] The token cache is being invalidate because project bb954603f9d1464eac1998f48e377d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:43.791434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.792081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:43.793642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1113/2266] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:43 2022] DELETE /identity/v3/projects/bb954603f9d1464eac1998f48e377d00 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:43.797607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:43.813691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e6a91-064d-4c6a-87ea-b8e426f5d87f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:43.871477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:43.872353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:43.872639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:43.872917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] PATH_INFO: `/v3/users/c514cd5bb92d4cf9b5f54da5f7be3adb` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:43.874133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c514cd5bb92d4cf9b5f54da5f7be3adb)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:43.876048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:44.124964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c514cd5bb92d4cf9b5f54da5f7be3adb'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.138851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c514cd5bb92d4cf9b5f54da5f7be3adb'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.139599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c514cd5bb92d4cf9b5f54da5f7be3adb'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.140203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c514cd5bb92d4cf9b5f54da5f7be3adb'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.147604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5b2ee449-9a22-4b51-a3a9-b646df2d4096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c514cd5bb92d4cf9b5f54da5f7be3adb'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.196839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1154/2267] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:43 2022] DELETE /identity/v3/users/c514cd5bb92d4cf9b5f54da5f7be3adb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:44.641741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:44.642407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:44.658276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9b94-92bc-43ad-ba92-5ee25e631ea9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:44.674916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:44.726189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:44.727180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:44.727443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:44.727725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] PATH_INFO: `/v3/projects/7fd7daa79a044d7cb1760f5506091be0` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:44.728922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd7daa79a044d7cb1760f5506091be0)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:44.730866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:44.821280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd7daa79a044d7cb1760f5506091be0', 'request_id': 'req-6bbc3c26-ad10-407e-9b24-0882ad429e1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.882047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd7daa79a044d7cb1760f5506091be0', 'request_id': 'req-6bbc3c26-ad10-407e-9b24-0882ad429e1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.888627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd7daa79a044d7cb1760f5506091be0', 'request_id': 'req-6bbc3c26-ad10-407e-9b24-0882ad429e1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.901107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] The token cache is being invalidate because project 7fd7daa79a044d7cb1760f5506091be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:44.901489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.902463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6bbc3c26-ad10-407e-9b24-0882ad429e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:44.904067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1114/2268] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:44 2022] DELETE /identity/v3/projects/7fd7daa79a044d7cb1760f5506091be0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:44.909143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:44.909715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:44.909823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:44.928409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:44.929641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:44.975207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:44.991068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1155/2269] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:24:44.998976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:44.999449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:44.999745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.019496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:45.020768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:45.029077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1115/2270] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:45.033351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.043596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4812e1-19d9-4cea-bdf8-4c99a5d4707f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.048243 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.052540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.069443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1156/2271] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:24:45.072413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.088154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd64c22-22d5-420e-9d8a-b8c7c9b5aad2 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.092926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.093620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.093907 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.094182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.094877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.096770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.169745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1116/2272] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:45 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:45.174032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.183927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2cf6d-646a-4656-8320-dcedee850d49 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.244634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.245379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.245833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.246120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.246820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.248819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.322127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1157/2273] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:45 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:45.326242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.337221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2735b7-c265-48f4-b92c-5c52db153c7d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.341912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.347625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.347625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.347625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.347625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.347625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.356440 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1117/2274] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:45.360329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.371677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251e15-66b5-4ad4-94ea-7eb7314bfe27 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.376292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.377088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.377972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.378258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.379191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.380805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f03eb8-ebdd-4ce6-95a4-5398ef3daaa7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.390664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1158/2275] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:45.394827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.405146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4791834-e0ad-4108-a951-84180236a3b4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.410072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.410952 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.411233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.411504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] PATH_INFO: `/v3/projects/9b08ee1853aa41eabec26eb3df4b84ac/users/1baf45dcce4345e79b14728306291728/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.427641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b08ee1853aa41eabec26eb3df4b84ac, user_id=1baf45dcce4345e79b14728306291728, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.430344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.512066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1118/2276] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:45 2022] PUT /identity/v3/projects/9b08ee1853aa41eabec26eb3df4b84ac/users/1baf45dcce4345e79b14728306291728/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:45.522831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.525069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.525069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.552823 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] MFA Rules not processed for user `1baf45dcce4345e79b14728306291728`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:45.554253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:45.619295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1159/2277] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:45.623912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.666644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:45.688079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fca63-0ec2-41ab-b50e-66c1835d1f02 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.693089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.694041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.694764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.695056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.695824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.697768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.792598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1119/2278] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:45 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:45.796723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:45.808160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08355b-cfd5-4cf7-b9b7-a497e3cbd8dd None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:45.854854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:45.872090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:45.872762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:45.873046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:45.873324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:45.874097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:45.876040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:45.987342 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1160/2279] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:45 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:45.990671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.001043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0e9a-53d8-4498-9e96-a142d474235f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.005882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.006546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.006836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.007114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.007850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.009462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.021348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1120/2280] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:46.029866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.041235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090553-dd58-4c0e-b14a-af9b34b259da admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.046379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.047477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.047830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.048107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.048833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.050667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc8099-f3d0-406c-b3e4-3397468b1473 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.060649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1161/2281] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:46.065230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.077875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d930b3-1c95-4747-9fc4-2470a6ad5d8c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.083532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.084427 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.084708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.084981 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] PATH_INFO: `/v3/projects/5511eaab067c44dc8f443a4a009a9339/users/85c4868979c54773b188a948146e7c73/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.102135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5511eaab067c44dc8f443a4a009a9339, user_id=85c4868979c54773b188a948146e7c73, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.104856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.218385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1121/2282] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:46 2022] PUT /identity/v3/projects/5511eaab067c44dc8f443a4a009a9339/users/85c4868979c54773b188a948146e7c73/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:46.229378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.229695 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.229977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.256910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] MFA Rules not processed for user `85c4868979c54773b188a948146e7c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:46.258096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:46.329485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1162/2283] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:46.334616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.398146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adfc7b-72fd-4819-a093-9f4e4e49038d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.403386 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.404169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.404453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.404840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.405742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.407925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.500434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1122/2284] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:24:46 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:24:46.505060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.515769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304220e6-862d-4cb0-a89d-86562711cd30 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.574019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.574688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.574971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.575246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.575937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.577924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.688668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1163/2285] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:24:46 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:24:46.693117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.703521 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7b2a-ea37-4082-bf3c-882d43091548 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.709602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.710279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.710566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.710843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.711574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.713173 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.724331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1123/2286] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:46.728303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.744664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa909-37ca-4873-b47e-b76fd5913e13 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.749683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.750616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.750908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.751678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] PATH_INFO: `/v3/projects/9e72f83d214445c5abf97323e51e148f/users/d94dc6bf9cfe4486ac985633b6ea6dc3/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.768224 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e72f83d214445c5abf97323e51e148f, user_id=d94dc6bf9cfe4486ac985633b6ea6dc3, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.770864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.841780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1164/2287] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:46 2022] PUT /identity/v3/projects/9e72f83d214445c5abf97323e51e148f/users/d94dc6bf9cfe4486ac985633b6ea6dc3/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:46.846545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.859466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11b1c9-cf51-4068-9163-946174f822a2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.923906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.925287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.925587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.925874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.926609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.928216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d439-9fba-4b6b-90dd-049ff92c9393 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.930946 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:46.939147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1124/2288] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:24:46.950050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:46.954954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895d31-4dc6-4725-a4f9-c1b4bdf3f7bc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:46.962289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:46.963197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:46.963473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:46.963753 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] PATH_INFO: `/v3/projects/9e72f83d214445c5abf97323e51e148f/users/d94dc6bf9cfe4486ac985633b6ea6dc3/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:46.966231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e72f83d214445c5abf97323e51e148f, user_id=d94dc6bf9cfe4486ac985633b6ea6dc3, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:46.968470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:46.980474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1165/2289] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:24:46 2022] PUT /identity/v3/projects/9e72f83d214445c5abf97323e51e148f/users/d94dc6bf9cfe4486ac985633b6ea6dc3/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:47.049683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:47.049898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:47.050435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:47.078840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] MFA Rules not processed for user `d94dc6bf9cfe4486ac985633b6ea6dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:47.080090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:47.150397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1125/2290] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:47.162320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:47.164114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:47.171957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:47.226191 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d67a5-8930-4d88-a153-22f9fb79533d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:47.230120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:47.230771 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:47.231058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:47.231336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:47.290782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:47.292240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:47.302922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1166/2291] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:50.312269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:50.313714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:50.327466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e9d57-3fbd-49db-81ca-e688213b9d75 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:50.333154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:50.333859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:50.334143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:50.334421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:50.401842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:50.403553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:50.414535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1126/2292] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:52.102021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:52.111394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793704c-2db2-41f8-af83-6811c8aa3b40 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:52.115426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:52.116099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:52.116387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:52.116665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:52.134929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:52.136321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122bf4a-4315-4798-bd56-094ece408430 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:52.157664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1167/2293] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:57.791816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:57.874593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872560ca-5568-4cdb-8623-2e23495f0e92 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:57.881443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:57.882401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:57.882680 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:57.882970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] PATH_INFO: `/v3/users/1baf45dcce4345e79b14728306291728` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:57.884135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1baf45dcce4345e79b14728306291728)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:57.886142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:57.912371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:58.060153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1baf45dcce4345e79b14728306291728'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.060815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1baf45dcce4345e79b14728306291728'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.061421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1baf45dcce4345e79b14728306291728'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.069364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1baf45dcce4345e79b14728306291728'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.137843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1baf45dcce4345e79b14728306291728'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.157754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1127/2294] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:57 2022] DELETE /identity/v3/users/1baf45dcce4345e79b14728306291728 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:58.162283 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:58.162742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:58.162884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:58.180841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:24:58.182101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:58.242038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1168/2295] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:24:58.251818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:58.253937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:58.316222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e4717-5b35-4bca-9d2b-9c98e85c5639 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:58.320587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:58.321321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:58.321805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:58.322062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:58.332804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:58.334301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:58.344661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1128/2296] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:24:58.763501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:58.765273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:58.779853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bf4e4-859e-4ce3-9dd2-e8dcff39c805 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:58.785944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:58.787015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:58.787304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:58.787583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] PATH_INFO: `/v3/projects/9b08ee1853aa41eabec26eb3df4b84ac` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:58.788804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b08ee1853aa41eabec26eb3df4b84ac)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:58.790812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:58.911835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:58.918379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b08ee1853aa41eabec26eb3df4b84ac', 'request_id': 'req-1668c7bd-8924-478a-a1bb-2a4f1dec510d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:58.924141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b08ee1853aa41eabec26eb3df4b84ac', 'request_id': 'req-1668c7bd-8924-478a-a1bb-2a4f1dec510d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.065021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b08ee1853aa41eabec26eb3df4b84ac', 'request_id': 'req-1668c7bd-8924-478a-a1bb-2a4f1dec510d'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.077508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] The token cache is being invalidate because project 9b08ee1853aa41eabec26eb3df4b84ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:24:59.078026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.078747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.080946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1169/2297] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:58 2022] DELETE /identity/v3/projects/9b08ee1853aa41eabec26eb3df4b84ac => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:59.085035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:59.094974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c121-75bf-4a88-8102-95083a207a05 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:59.153106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:59.153931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:59.154220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:59.154569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] PATH_INFO: `/v3/users/85c4868979c54773b188a948146e7c73` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:59.155796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c4868979c54773b188a948146e7c73)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:59.158002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:24:59.349210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:24:59.350800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c4868979c54773b188a948146e7c73'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.351505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c4868979c54773b188a948146e7c73'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.352104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c4868979c54773b188a948146e7c73'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.359268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c4868979c54773b188a948146e7c73'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.453555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c4868979c54773b188a948146e7c73'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:24:59.476177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1129/2298] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:24:59 2022] DELETE /identity/v3/users/85c4868979c54773b188a948146e7c73 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:24:59.900668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:24:59.902475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:24:59.923713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668c7bd-8924-478a-a1bb-2a4f1dec510d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:24:59.985144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:24:59.985969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:24:59.986250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:24:59.987133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] PATH_INFO: `/v3/projects/5511eaab067c44dc8f443a4a009a9339` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:24:59.988593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5511eaab067c44dc8f443a4a009a9339)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:24:59.990573 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:00.106989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5511eaab067c44dc8f443a4a009a9339', 'request_id': 'req-5a79ccc2-aba5-4719-905b-1c1b080bcd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.112863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5511eaab067c44dc8f443a4a009a9339', 'request_id': 'req-5a79ccc2-aba5-4719-905b-1c1b080bcd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.196027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5511eaab067c44dc8f443a4a009a9339', 'request_id': 'req-5a79ccc2-aba5-4719-905b-1c1b080bcd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.209344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] The token cache is being invalidate because project 5511eaab067c44dc8f443a4a009a9339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:00.209698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.210356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.212700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1170/2299] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:24:59 2022] DELETE /identity/v3/projects/5511eaab067c44dc8f443a4a009a9339 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:00.216870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:00.218300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:00.231187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1aeec-d90d-4a41-bdcb-2b4c9da63d55 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:00.287707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:00.288506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:00.288793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:00.289072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] PATH_INFO: `/v3/users/d94dc6bf9cfe4486ac985633b6ea6dc3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:00.290316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94dc6bf9cfe4486ac985633b6ea6dc3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:00.292246 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:00.527378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94dc6bf9cfe4486ac985633b6ea6dc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.528050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94dc6bf9cfe4486ac985633b6ea6dc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.528650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94dc6bf9cfe4486ac985633b6ea6dc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.536204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94dc6bf9cfe4486ac985633b6ea6dc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.601748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d138ef8c-2f68-4db8-9cb1-7b80c6c09321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94dc6bf9cfe4486ac985633b6ea6dc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:00.622872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1130/2300] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:00 2022] DELETE /identity/v3/users/d94dc6bf9cfe4486ac985633b6ea6dc3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:01.038854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.040607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:01.055998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79ccc2-aba5-4719-905b-1c1b080bcd61 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.119894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.120768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.121055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.121334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] PATH_INFO: `/v3/projects/9e72f83d214445c5abf97323e51e148f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.122567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e72f83d214445c5abf97323e51e148f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.124489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.125986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:01.233188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e72f83d214445c5abf97323e51e148f', 'request_id': 'req-10f74b15-a6a6-432a-8956-2524828dace7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:01.239194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e72f83d214445c5abf97323e51e148f', 'request_id': 'req-10f74b15-a6a6-432a-8956-2524828dace7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:01.333634 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e72f83d214445c5abf97323e51e148f', 'request_id': 'req-10f74b15-a6a6-432a-8956-2524828dace7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:01.345354 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] The token cache is being invalidate because project 9e72f83d214445c5abf97323e51e148f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:01.345679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:01.346412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-10f74b15-a6a6-432a-8956-2524828dace7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:01.348835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1171/2301] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:01 2022] DELETE /identity/v3/projects/9e72f83d214445c5abf97323e51e148f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:01.355176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.355826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.355826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.379529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:01.380969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:01.422406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:01.443849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1131/2302] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:25:01.451477 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.451778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.452063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.471600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:01.472911 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:01.481729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1172/2303] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:01.485276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.495201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ea25-b89c-4a34-80fd-bb2c2b958df0 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.499885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.500539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.500822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.501089 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.502544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:25:01.502851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.504433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.517658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1132/2304] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:25:01.522728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.532280 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6deb6-5f0a-42f4-8fe4-41228812bf49 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.537669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.538323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.538610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.538888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.539588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.541585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.644291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1173/2305] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:01 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:01.650460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.661754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7dedc-2c29-4493-a017-1d532b2041ec admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.736220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.737668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.737960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.738237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.738943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.740876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.831101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1133/2306] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:01 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:01.835489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.846069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8857c3-cbd4-42d4-bfd6-c0b710977d58 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.850754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.851413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.851703 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.851985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.852717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.854369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.866059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1174/2307] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:01.875144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.886237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9c15-0516-4859-81d6-0400eadc99c0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.891048 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.891719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.892005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.892281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.893424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.895137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc09c56-18b8-49fb-adcc-a305f6eb1a6b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:01.905539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1134/2308] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:01.909814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:01.919844 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e2f7b-4bae-4b1a-a3e4-d8bf9b8d43e5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:01.925536 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:01.926501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:01.931387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:01.931387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] PATH_INFO: `/v3/projects/cf095233ab9f4da6bf6d43c4b0f7ef3a/users/5cbac10fa115440ea2fd2a4d8e679db4/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:01.942619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf095233ab9f4da6bf6d43c4b0f7ef3a, user_id=5cbac10fa115440ea2fd2a4d8e679db4, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:01.945369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:02.036704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1175/2309] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:01 2022] PUT /identity/v3/projects/cf095233ab9f4da6bf6d43c4b0f7ef3a/users/5cbac10fa115440ea2fd2a4d8e679db4/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:02.047279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:02.047575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:02.047858 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:02.075455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] MFA Rules not processed for user `5cbac10fa115440ea2fd2a4d8e679db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:02.076661 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:02.140632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1135/2310] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:02.153213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:02.155204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:02.214602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566e87-9795-416b-8bd7-4d617b8ed446 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:02.218320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:02.218965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:02.219252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:02.219530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:02.228598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:02.230082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4660-dad2-4d1a-8e9e-93b50d0e886b service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:02.239755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1176/2311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:12.137414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:12.234809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:22.252722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:22.254180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:22.332017 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef567-8ffd-4d3c-b2e1-9c576cea315c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:22.336623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:22.337508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:22.337835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:22.338083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] PATH_INFO: `/v3/users/f0169e3cfa8d4c9a9376e2ec57fafe1f` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:22.339285 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0169e3cfa8d4c9a9376e2ec57fafe1f)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:22.341407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:22.525220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0169e3cfa8d4c9a9376e2ec57fafe1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:22.525969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0169e3cfa8d4c9a9376e2ec57fafe1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:22.526732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0169e3cfa8d4c9a9376e2ec57fafe1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:22.535268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0169e3cfa8d4c9a9376e2ec57fafe1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:22.619402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0169e3cfa8d4c9a9376e2ec57fafe1f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:22.638704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1136/2312] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:22 2022] DELETE /identity/v3/users/f0169e3cfa8d4c9a9376e2ec57fafe1f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:22.644112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:22.644619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:22.644715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:22.663158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:22.664386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:22.735619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1177/2313] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:22.743528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:22.745036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:22.805865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f5c2d-8a14-4c70-a88a-6944b8c908e1 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:22.809505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:22.810191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:22.810475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:22.810754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:22.820643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:22.822151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:22.831908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1137/2314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:23.248240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.249824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.263087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfc2a5-ad8c-48cb-9db3-4f9b0cc02bbb None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.268629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.273737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.273737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.273737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] PATH_INFO: `/v3/projects/311049591d254a94b2759592e29f1c10` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.273737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311049591d254a94b2759592e29f1c10)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.274177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:23.336161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.337701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.351691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7ae66-b97f-4fbb-a5f0-588479b4818a service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.356366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.357237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.359467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.359467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] PATH_INFO: `/v3/users/5cbac10fa115440ea2fd2a4d8e679db4` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.359467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbac10fa115440ea2fd2a4d8e679db4)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.361645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:23.378866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:23.396929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311049591d254a94b2759592e29f1c10', 'request_id': 'req-3fb43d2a-9069-4784-bd6a-98e363efa7a1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.403261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311049591d254a94b2759592e29f1c10', 'request_id': 'req-3fb43d2a-9069-4784-bd6a-98e363efa7a1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.505057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311049591d254a94b2759592e29f1c10', 'request_id': 'req-3fb43d2a-9069-4784-bd6a-98e363efa7a1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.516485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] The token cache is being invalidate because project 311049591d254a94b2759592e29f1c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:23.516768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.517915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3fb43d2a-9069-4784-bd6a-98e363efa7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.519485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1178/2315] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:23 2022] DELETE /identity/v3/projects/311049591d254a94b2759592e29f1c10 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:23.524997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96901-4578-4785-b396-b510935fa14f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.525291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96901-4578-4785-b396-b510935fa14f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.525671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96901-4578-4785-b396-b510935fa14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.547296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bdc96901-4578-4785-b396-b510935fa14f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:23.548602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bdc96901-4578-4785-b396-b510935fa14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.565974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbac10fa115440ea2fd2a4d8e679db4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.575584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbac10fa115440ea2fd2a4d8e679db4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.576320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbac10fa115440ea2fd2a4d8e679db4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.584615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbac10fa115440ea2fd2a4d8e679db4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.610985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1179/2316] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:25:23.619670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.619969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.625096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.636139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f284d186-a24f-45b7-baab-e9d0211413cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbac10fa115440ea2fd2a4d8e679db4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:23.638192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:23.639411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.648369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1180/2317] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:25:23.652743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.655861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1138/2318] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:23 2022] DELETE /identity/v3/users/5cbac10fa115440ea2fd2a4d8e679db4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:23.661145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.661441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.661762 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.664738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d549d2-ed1b-4139-a1d4-407105fed8f7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.677284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:23.679774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:23.681000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.723425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.724511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.724877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.725156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.725907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:25:23.726215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.728890 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:23.743515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1181/2319] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:25:23.744515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.746543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1139/2320] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:23.754878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204d8a-34f0-4fa8-859d-94ce6754325c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.759373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.759765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.760571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.760888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.761015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:23.761168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.761896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.763789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:23.821416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac27359-0c78-42d4-b4de-568fab244f46 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.825140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.825851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.826138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.826470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.836364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.837836 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:23.848314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1140/2321] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:25:23.854809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1182/2322] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:23 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:25:23.858747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:23.868732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430df27-640b-4835-b1ba-81cd86416f61 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:23.904733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:23.929113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:23.929816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:23.930100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:23.930404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:23.931103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:23.933153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.049724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1141/2323] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:23 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:24.054081 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.073278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40293572-5221-4c20-b768-cf534bb00749 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.078824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.079757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.080842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.081123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.081908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.083529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.096934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1183/2324] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:24.100976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.111205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f96f9-6d22-4e73-b01d-0ff0f016686f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.116355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.117028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.117309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.117612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.118352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.119944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab23d1-fac2-440c-9c9d-536b2b7ad278 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.131030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1142/2325] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:24.135230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.146960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2adb-82d1-4bc7-8884-bd87ad621d5c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.152223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.153120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.153400 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.153720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] PATH_INFO: `/v3/projects/e64a9121bbbf4329a56e25cdd49ffdad/users/4fb7a817f9e543f9958460d3c11595c3/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.169450 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64a9121bbbf4329a56e25cdd49ffdad, user_id=4fb7a817f9e543f9958460d3c11595c3, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.172121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.277610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1184/2326] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:24 2022] PUT /identity/v3/projects/e64a9121bbbf4329a56e25cdd49ffdad/users/4fb7a817f9e543f9958460d3c11595c3/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:24.282987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.283530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.283784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.301615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.306986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:24.322734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:24.324059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:24.417773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1143/2327] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:24.424584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d5ccb-fd2c-43df-b9a9-250ea558f16b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.429200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.430015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.430700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:24.430937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.433071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.433071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] PATH_INFO: `/v3/projects/cf095233ab9f4da6bf6d43c4b0f7ef3a` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.433071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf095233ab9f4da6bf6d43c4b0f7ef3a)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.434816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.490620 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d98cd-8278-46c2-b2b0-cc8dcae2a3f9 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.494257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.494906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.495192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.495467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.504922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.506411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80d163-8976-423e-a21e-4b263efe3049 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.516028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1144/2328] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:25:24.556666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf095233ab9f4da6bf6d43c4b0f7ef3a', 'request_id': 'req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:24.561198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:24.562393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf095233ab9f4da6bf6d43c4b0f7ef3a', 'request_id': 'req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:24.659134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf095233ab9f4da6bf6d43c4b0f7ef3a', 'request_id': 'req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:24.673031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] The token cache is being invalidate because project cf095233ab9f4da6bf6d43c4b0f7ef3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:24.673799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:24.674772 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-9e9ebcbb-b3f6-4c5a-8900-956dff66cd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:24.676497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1185/2329] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:24 2022] DELETE /identity/v3/projects/cf095233ab9f4da6bf6d43c4b0f7ef3a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:24.681583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.681880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.682156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.708717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:24.710076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:24.770450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:24.779139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1145/2330] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:24.787059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.787359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.787672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.806736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:24.807934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:24.820267 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1186/2331] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:24.824651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.835081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67c3a5-c217-4241-9763-11f273a5e08d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.840458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.840458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.840775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.841712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.843360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:25:24.843692 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.846323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:24.863889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1146/2332] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:25:24.865083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:24.874506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fdace-20dd-4520-9f24-3fa7c15edea2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:24.880033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:24.880508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:24.880801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:24.881077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:24.881819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:24.883738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.022627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1187/2333] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:24 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:25.027469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:25.039216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468f5e-6995-4ff0-9a20-caecd22f8d6c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:25.101674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:25.103259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.103259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.103259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.103546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:25.105307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.226568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1147/2334] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:25 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:25.230836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:25.241850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7a735-ab55-42b1-9ef8-2f8b39a05d34 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:25.246459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:25.247125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.247439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.247744 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.248476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:25.250130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.272223 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1188/2335] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:25.276306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:25.287546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f495147-8090-4ee2-8a0b-0993373cf459 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:25.292901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:25.293605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.293901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.294185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.294925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:25.296544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52efdde-2ca9-4228-bceb-c3f23e7600dc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.308953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1148/2336] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:25.313012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:25.323548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566135c-26bf-4313-972d-4e4c09090add admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:25.332156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:25.332156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.332156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.332156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] PATH_INFO: `/v3/projects/c57431ed55584bf48ddf48eadca84feb/users/edcf398c3da94a65a6d8b42756b25cc9/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.347328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57431ed55584bf48ddf48eadca84feb, user_id=edcf398c3da94a65a6d8b42756b25cc9, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:25.350170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.461698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1189/2337] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:25 2022] PUT /identity/v3/projects/c57431ed55584bf48ddf48eadca84feb/users/edcf398c3da94a65a6d8b42756b25cc9/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:25.471998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ba769-ee2d-4466-a210-7e2fd03b7550 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.472549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ba769-ee2d-4466-a210-7e2fd03b7550 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.472813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ba769-ee2d-4466-a210-7e2fd03b7550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.505288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6c7ba769-ee2d-4466-a210-7e2fd03b7550 None None] MFA Rules not processed for user `edcf398c3da94a65a6d8b42756b25cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:25.506666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6c7ba769-ee2d-4466-a210-7e2fd03b7550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:25.583561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1149/2338] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:25.596391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:25.598299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:25.664338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee69d-fbea-4361-8861-5c0db1e2c503 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:25.670500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:25.671446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:25.671836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:25.672275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:25.683492 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:25.686312 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:25.697135 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1190/2339] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:26.251676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386647c6-2d6d-4ca0-bd31-5bb230d2941d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:26.252002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386647c6-2d6d-4ca0-bd31-5bb230d2941d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:26.252697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386647c6-2d6d-4ca0-bd31-5bb230d2941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:26.283569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-386647c6-2d6d-4ca0-bd31-5bb230d2941d None None] MFA Rules not processed for user `4fb7a817f9e543f9958460d3c11595c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:26.285056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-386647c6-2d6d-4ca0-bd31-5bb230d2941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:26.341245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:26.366708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1150/2340] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:26.377928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:26.379365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:26.390433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a459e5-b206-499b-9f81-373b802a8bc2 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:26.394689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:26.398597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:26.398597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:26.398597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:26.405167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:26.406637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:26.417805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1191/2341] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:28.473228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281ab6-2c20-465c-b15f-d21b4b192715 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:28.473796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281ab6-2c20-465c-b15f-d21b4b192715 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:28.474020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281ab6-2c20-465c-b15f-d21b4b192715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:28.478659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:28.480118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:28.492828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3a281ab6-2c20-465c-b15f-d21b4b192715 None None] MFA Rules not processed for user `4fb7a817f9e543f9958460d3c11595c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:28.494067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3a281ab6-2c20-465c-b15f-d21b4b192715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:28.501196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1151/2342] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:28.574884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461575bf-c4c0-49b0-9a20-a6330182ecc2 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:28.581875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:28.582775 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:28.583064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:28.583346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] PATH_INFO: `/v3/users/763b64aa4bc54c3f950f3766802ec1d7` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:28.585024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763b64aa4bc54c3f950f3766802ec1d7)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:28.586834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:28.601528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:28.824073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763b64aa4bc54c3f950f3766802ec1d7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:28.838499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763b64aa4bc54c3f950f3766802ec1d7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:28.839800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763b64aa4bc54c3f950f3766802ec1d7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:28.840524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763b64aa4bc54c3f950f3766802ec1d7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:28.848635 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763b64aa4bc54c3f950f3766802ec1d7'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:28.928421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1192/2343] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:28 2022] DELETE /identity/v3/users/763b64aa4bc54c3f950f3766802ec1d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:28.932951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:28.933251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:28.933537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:28.960887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:28.960887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:29.021788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1152/2344] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:29.032050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:29.033583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:29.095115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3590-b8a6-498d-8148-6c182f8bb3e0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:29.099126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:29.099831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:29.100212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:29.100701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:29.112334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:29.113832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0ec74-6bb7-4463-b02d-7dbd3151c923 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:29.129747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1193/2345] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:29.620537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:29.622073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:29.641838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc8b4-70e5-43ed-8266-f0ad960376ae None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:29.648534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:29.649419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:29.649741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:29.650202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] PATH_INFO: `/v3/projects/090a9693a6f74a0299837f6cc3432718` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:29.651565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090a9693a6f74a0299837f6cc3432718)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:29.653809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:29.780691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090a9693a6f74a0299837f6cc3432718', 'request_id': 'req-9358df3d-c0c8-4deb-9480-e90929f690d9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:29.853403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090a9693a6f74a0299837f6cc3432718', 'request_id': 'req-9358df3d-c0c8-4deb-9480-e90929f690d9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:29.861540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090a9693a6f74a0299837f6cc3432718', 'request_id': 'req-9358df3d-c0c8-4deb-9480-e90929f690d9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:29.875614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] The token cache is being invalidate because project 090a9693a6f74a0299837f6cc3432718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:29.876035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:29.876957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-9358df3d-c0c8-4deb-9480-e90929f690d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:29.878597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1153/2346] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:29 2022] DELETE /identity/v3/projects/090a9693a6f74a0299837f6cc3432718 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:29.884058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:29.884541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:29.884679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:29.905698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:29.906919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:29.966758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1194/2347] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:25:29.981241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:29.981241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:29.981241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:29.998146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:29.999564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:30.007572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1154/2348] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:30.012143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.022226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1bd2a-f88a-4b50-ac46-0a154ea73be7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.026875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.027790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.028074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.028350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.029143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:25:30.029437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.031102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.043917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1195/2349] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:25:30.048461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.058179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395410c-a2ed-467f-9ab2-480b7314cd9f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.062958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.063627 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.063982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.064300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.065160 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.067420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.203575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1155/2350] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:30 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:30.205337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.215921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b968-db93-45c9-9f2c-9e7ede38798f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.236504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:30.279468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.280158 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.280496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.280781 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.281591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.283672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.383505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1196/2351] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:30 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:30.384369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.396321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c78c8-c4dc-4153-81f4-e39eaab924e2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.401313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.402277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.402566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.402846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.403584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.405205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.417233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1156/2352] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:30.421361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.431514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa945e-8f09-440f-b333-15086e27350e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.436455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.437119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.439411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.439411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.439411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.440930 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695dbde-dc82-417b-96de-2e282c01071e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.451031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1197/2353] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:30.455800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.466508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00280-2afa-48d2-b747-aecd29f6c977 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.474586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.474586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.474586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.474586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] PATH_INFO: `/v3/projects/905eab8cb4c54959b893ded1e647ef5f/users/f1cf8604ac6c42e9bd2ab391c41ec573/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.515460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=905eab8cb4c54959b893ded1e647ef5f, user_id=f1cf8604ac6c42e9bd2ab391c41ec573, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.518754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.615090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:30.634719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1157/2354] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:30 2022] PUT /identity/v3/projects/905eab8cb4c54959b893ded1e647ef5f/users/f1cf8604ac6c42e9bd2ab391c41ec573/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:30.640071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.640691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.640691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.660088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:30.661322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:30.721669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1198/2355] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:30.731175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.733079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:30.738835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:30.740206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:30.798918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659c7-c121-45ee-9fa5-bea9154070cc admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.803162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.803957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.804240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.804517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.813281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5571e5-fe8d-499a-aef2-5f9969005e4b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:30.814835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.816358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.819497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:30.820816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:30.820816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:30.820816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:30.822671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:30.826177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1158/2356] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:30.835311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:30.836957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cf0c9-14df-43f5-a169-bf43d9d489a7 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:30.847802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1199/2357] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:32.854122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:32.857258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:32.876104 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0987e-e921-4497-be17-1bf849f20641 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:32.894736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:32.896033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:32.896660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:32.897124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] PATH_INFO: `/v3/users/edcf398c3da94a65a6d8b42756b25cc9` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:32.902678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=edcf398c3da94a65a6d8b42756b25cc9)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:32.905269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:33.116437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edcf398c3da94a65a6d8b42756b25cc9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:33.118469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edcf398c3da94a65a6d8b42756b25cc9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:33.119436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edcf398c3da94a65a6d8b42756b25cc9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:33.132321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edcf398c3da94a65a6d8b42756b25cc9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:33.237387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edcf398c3da94a65a6d8b42756b25cc9'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:33.257789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1159/2358] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:32 2022] DELETE /identity/v3/users/edcf398c3da94a65a6d8b42756b25cc9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:33.265153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:33.266069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:33.266726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:33.296227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:33.299011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:33.337187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:33.402339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1200/2359] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:33.418235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:33.419872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:33.504824 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7ea7-b8fe-46a3-91b5-c1a0b8750e7a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:33.509817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:33.510513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:33.514398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:33.514398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:33.522377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:33.523544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9e41-936c-4bac-8e46-0d5ccc3b560d service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:33.535773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1160/2360] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:34.267102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:34.269586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:34.288079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74513b2-a56a-4896-980d-777da3d8372e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:34.299585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:34.300949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:34.301383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:34.301851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] PATH_INFO: `/v3/projects/c57431ed55584bf48ddf48eadca84feb` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:34.307345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57431ed55584bf48ddf48eadca84feb)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:34.332027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:34.528618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57431ed55584bf48ddf48eadca84feb', 'request_id': 'req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:34.537714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57431ed55584bf48ddf48eadca84feb', 'request_id': 'req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:34.597811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57431ed55584bf48ddf48eadca84feb', 'request_id': 'req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:34.612088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] The token cache is being invalidate because project c57431ed55584bf48ddf48eadca84feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:34.612768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:34.613664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:34.615537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1201/2361] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:34 2022] DELETE /identity/v3/projects/c57431ed55584bf48ddf48eadca84feb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:37.085051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.086143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.086430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.120033 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] MFA Rules not processed for user `f1cf8604ac6c42e9bd2ab391c41ec573`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:37.121281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:37.125606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:37.193060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1161/2362] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:37.197480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.198975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:37.284001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81f8c-cb5f-4df5-83ac-9f6c8a82dd59 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.289009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.289955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.290831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.290831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.291359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.293311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.414943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1202/2363] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:37 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:37.419076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.430619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4180a1-052e-4ce7-9c5a-3ffb95b234fe None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.495747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.496492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.496769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.497045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.497823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.499759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.608039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1162/2364] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:37 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:37.612723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.625622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0d44-988c-46e2-ba23-e5461810d7b3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.632062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.632392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.632683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.632973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.633776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.635397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.657256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.658206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1203/2365] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:37.674220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee801a-bad5-48f2-b924-623ee33d704a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.680361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.681346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.681757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.682136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] PATH_INFO: `/v3/projects/88db6f1d0ab74c9696f85854d58a076f/users/81d5d4501f6444f49737a38083445a61/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.702933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88db6f1d0ab74c9696f85854d58a076f, user_id=81d5d4501f6444f49737a38083445a61, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.706398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.791645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1163/2366] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:37 2022] PUT /identity/v3/projects/88db6f1d0ab74c9696f85854d58a076f/users/81d5d4501f6444f49737a38083445a61/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:25:37.795748 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.806376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2de25-8220-457c-96e3-d00a2b403fd8 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.830710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:37.867498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.868211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.868498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.868806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.869575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.871218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.881623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1204/2367] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:37.886027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:37.899619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ea314-16f9-4fe4-9702-9ea69ce13530 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:37.904984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888887-da2b-4763-9413-837102700dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:37.905927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888887-da2b-4763-9413-837102700dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:37.906210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888887-da2b-4763-9413-837102700dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:37.906484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888887-da2b-4763-9413-837102700dde admin admin] PATH_INFO: `/v3/projects/88db6f1d0ab74c9696f85854d58a076f/users/81d5d4501f6444f49737a38083445a61/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:37.910906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888887-da2b-4763-9413-837102700dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=88db6f1d0ab74c9696f85854d58a076f, user_id=81d5d4501f6444f49737a38083445a61, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:37.913972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888887-da2b-4763-9413-837102700dde admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:37.927184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1164/2368] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:37 2022] PUT /identity/v3/projects/88db6f1d0ab74c9696f85854d58a076f/users/81d5d4501f6444f49737a38083445a61/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:38.043598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:38.047387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:38.059310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e4cb7-d5d2-41a8-8ca1-6ba691f06963 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:38.126717 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:38.127680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:38.128087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:38.128372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] PATH_INFO: `/v3/users/658a9f9907684d668cf0e6675442a6d2` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:38.129741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658a9f9907684d668cf0e6675442a6d2)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:38.131697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:38.337205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658a9f9907684d668cf0e6675442a6d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:38.351832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658a9f9907684d668cf0e6675442a6d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:38.352756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658a9f9907684d668cf0e6675442a6d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:38.353418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658a9f9907684d668cf0e6675442a6d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:38.364225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658a9f9907684d668cf0e6675442a6d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:38.498230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1205/2369] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:38 2022] DELETE /identity/v3/users/658a9f9907684d668cf0e6675442a6d2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:38.505018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:38.505018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:38.505018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:38.526679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:38.528076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:38.591200 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:38.601414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1165/2370] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:38.612237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:38.613783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:38.668252 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:38.679986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d289-b8a9-4fe3-be1e-14428ef1c419 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:38.684817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:38.686107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:38.686394 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:38.686671 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:38.699774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:38.703216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b87d8-9370-4d63-8677-b2f4b2b66024 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:38.715574 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1206/2371] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:39.495629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:39.497199 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:39.526291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c7bc6-cd68-4080-8ecc-5adffdc6e11a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:39.531402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:39.532515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:39.533140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:39.533428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] PATH_INFO: `/v3/projects/cc4d8cd69c9b45ec8655e45f81852453` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:39.536902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4d8cd69c9b45ec8655e45f81852453)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:39.539019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:39.750407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4d8cd69c9b45ec8655e45f81852453', 'request_id': 'req-58a9faba-a73c-46d2-b27a-8aa3cc903870'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:39.825664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4d8cd69c9b45ec8655e45f81852453', 'request_id': 'req-58a9faba-a73c-46d2-b27a-8aa3cc903870'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:39.833780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4d8cd69c9b45ec8655e45f81852453', 'request_id': 'req-58a9faba-a73c-46d2-b27a-8aa3cc903870'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:39.850834 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] The token cache is being invalidate because project cc4d8cd69c9b45ec8655e45f81852453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:39.853909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:39.854773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-58a9faba-a73c-46d2-b27a-8aa3cc903870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:39.858344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1166/2372] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:39 2022] DELETE /identity/v3/projects/cc4d8cd69c9b45ec8655e45f81852453 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:39.866794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:39.867754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:39.868221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:39.895755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:39.897271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:39.971952 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1207/2373] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:25:39.980441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:39.980736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:39.981070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.002802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:40.003923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:40.016287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1167/2374] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:40.017625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.028391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a524-8dc0-443b-a191-095edaa0c720 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.035168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.035850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.036134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.036409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.037340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:25:40.038077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.039742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:40.054998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1208/2375] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:25:40.058979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.083035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659395a3-b016-4ea5-9191-52ef2669d076 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.092791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.093486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.093801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.094080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.094790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.097436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:40.304098 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1168/2376] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:25:40 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:40.308194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.330303 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bea-9f50-4f17-a321-d12ba8b7382a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.520620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.522063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.522567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.523030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.523944 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.526883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:40.648523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1209/2377] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:25:40 2022] POST /identity/v3/users => generated 286 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:25:40.653117 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.675719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1caed-7350-4877-9d2c-e2e7e8fa1169 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.683333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.684092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.684382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.684663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.685468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.687322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:40.710868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1169/2378] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:40.723570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.769916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8934a-ee71-41b4-bf88-5c887acb1eea admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.782874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.786231 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.787416 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.798852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.798852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.798852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32979-b0b5-4aad-a5ad-76d8ed093c9c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:40.833615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:40.840889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1210/2379] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:25:40.848278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181124-6476-40a0-ba79-72896fc45550 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:40.858651 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:40.862969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:40.865328 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:40.867512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] PATH_INFO: `/v3/projects/3b2367f062214fce9d7ca7dee30dbc8e/users/844f506b74f647ae97d2e0faabfd7f23/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:40.919395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2367f062214fce9d7ca7dee30dbc8e, user_id=844f506b74f647ae97d2e0faabfd7f23, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:40.931796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:41.081249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1170/2380] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:25:40 2022] PUT /identity/v3/projects/3b2367f062214fce9d7ca7dee30dbc8e/users/844f506b74f647ae97d2e0faabfd7f23/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:41.091429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:41.091995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:41.091995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:41.132986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] MFA Rules not processed for user `844f506b74f647ae97d2e0faabfd7f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:41.134377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:41.201123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:41.235001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1211/2381] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:41.246931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:41.249126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:41.325453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd04e6-183a-4a31-a57e-2f0202ed51ad admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:41.330304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:41.331191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:41.331792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:41.332358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:41.348240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:41.351166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce4956-b730-417c-a350-29699c03473b service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:41.365448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1171/2382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:41.394209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:41.480036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32c5ff-0edd-435e-97b3-d5d2e67c222c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:41.488798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:41.489969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:41.490431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:41.490974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] PATH_INFO: `/v3/users/844f506b74f647ae97d2e0faabfd7f23` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:41.493548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=844f506b74f647ae97d2e0faabfd7f23)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:41.497715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:41.768962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844f506b74f647ae97d2e0faabfd7f23'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:41.801132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844f506b74f647ae97d2e0faabfd7f23'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:41.806969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844f506b74f647ae97d2e0faabfd7f23'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:41.815088 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844f506b74f647ae97d2e0faabfd7f23'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:41.879906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844f506b74f647ae97d2e0faabfd7f23'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:42.042612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1212/2383] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:25:41 2022] DELETE /identity/v3/users/844f506b74f647ae97d2e0faabfd7f23 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:42.050020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:42.050566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:42.050566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:42.068070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:42.069326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:42.082412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:42.131793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1172/2384] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:42.141512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:42.144250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:42.209810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54c4dd-7365-4ca1-83ee-ff11b597c47f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:42.213739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:42.214596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:42.214878 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:42.215154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:42.225989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:42.232418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8f266-ab27-435d-85c3-d340ba78b4c2 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:42.242994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1213/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:25:42.764930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:42.766132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:42.779354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357dbbd-75bf-435f-9e4a-8b0a2763432b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:42.792494 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:42.793390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:42.793698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:42.794133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] PATH_INFO: `/v3/projects/3b2367f062214fce9d7ca7dee30dbc8e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:42.797178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2367f062214fce9d7ca7dee30dbc8e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:42.799784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:42.945549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2367f062214fce9d7ca7dee30dbc8e', 'request_id': 'req-01153795-c6c1-4e1f-8eb9-c8964410cb30'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:43.061094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2367f062214fce9d7ca7dee30dbc8e', 'request_id': 'req-01153795-c6c1-4e1f-8eb9-c8964410cb30'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:43.066991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2367f062214fce9d7ca7dee30dbc8e', 'request_id': 'req-01153795-c6c1-4e1f-8eb9-c8964410cb30'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:43.097623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] The token cache is being invalidate because project 3b2367f062214fce9d7ca7dee30dbc8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:25:43.098024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:43.098847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:25:43.101201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1173/2386] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:25:42 2022] DELETE /identity/v3/projects/3b2367f062214fce9d7ca7dee30dbc8e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:25:46.128307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af20-dc91-488f-9724-0dd9bb166adc None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:46.128834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af20-dc91-488f-9724-0dd9bb166adc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:46.128935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af20-dc91-488f-9724-0dd9bb166adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:46.135725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:46.160751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0f38af20-dc91-488f-9724-0dd9bb166adc None None] MFA Rules not processed for user `81d5d4501f6444f49737a38083445a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:46.162036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f38af20-dc91-488f-9724-0dd9bb166adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:46.246025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1214/2387] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:46.260099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:25:46.261533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:46.348316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01153795-c6c1-4e1f-8eb9-c8964410cb30 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:25:46.354687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:25:46.355385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:46.355667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:46.355948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:46.357847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:46.402857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:46.420656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:25:46.422309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840332e3-2a98-47f4-8802-c67cdbef2e1b service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:25:46.431864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1174/2388] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:25:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:25:47.845901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa49e9-3af4-4691-b266-d49c515fe26b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:47.847077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa49e9-3af4-4691-b266-d49c515fe26b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:47.847641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa49e9-3af4-4691-b266-d49c515fe26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:48.004527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-c8fa49e9-3af4-4691-b266-d49c515fe26b None None] MFA Rules not processed for user `dd736a7cc9ef4e8787af2edc928dee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:48.006036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-c8fa49e9-3af4-4691-b266-d49c515fe26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:48.076314 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1215/2389] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:49.436869 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:25:49.437439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:25:49.437439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:25:49.462291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] MFA Rules not processed for user `f1cf8604ac6c42e9bd2ab391c41ec573`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:25:49.462291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:25:49.469593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1175/2390] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:25:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:25:58.068432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=58 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:25:59.452006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=12 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:26:17.648107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12989c-4462-4dbf-b5c6-d3ab42899e0c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:17.648738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12989c-4462-4dbf-b5c6-d3ab42899e0c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:17.648852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12989c-4462-4dbf-b5c6-d3ab42899e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:17.667508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5e12989c-4462-4dbf-b5c6-d3ab42899e0c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:17.668732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5e12989c-4462-4dbf-b5c6-d3ab42899e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:17.731982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1216/2391] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:26:17.754283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:17.779095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac718e-ea2f-49fb-bbcd-de69e493a2f7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:17.779095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:17.779095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:17.779095 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:17.779760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:17.786459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:17.788060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:17.798835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1176/2392] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:23.071480 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d726cb-d78d-4d7c-a41e-bd9ed5cb8df7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:23.071955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d726cb-d78d-4d7c-a41e-bd9ed5cb8df7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:23.072161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d726cb-d78d-4d7c-a41e-bd9ed5cb8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:23.092112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-65d726cb-d78d-4d7c-a41e-bd9ed5cb8df7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:23.093330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65d726cb-d78d-4d7c-a41e-bd9ed5cb8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:23.101339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1217/2393] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:26:23.128930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:23.140382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab170-7ce2-4713-8065-a1d98211665e service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:23.146761 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:23.147413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:23.147693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:23.147967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:23.167792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:23.169774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:23.182377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1177/2394] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:27.623706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9689c-77e4-499e-b0d1-c366b60b1f18 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:27.624232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9689c-77e4-499e-b0d1-c366b60b1f18 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:27.624347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9689c-77e4-499e-b0d1-c366b60b1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:27.641948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1af9689c-77e4-499e-b0d1-c366b60b1f18 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:27.643172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1af9689c-77e4-499e-b0d1-c366b60b1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:27.651063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1218/2395] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:26:27.671034 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:27.683147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4622-0786-4fdc-b36f-dc5f84a9a4cd service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:27.688624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:27.689266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:27.689551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:27.689893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:27.699466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:27.701096 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:27.711703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1178/2396] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:33.579940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:33.580353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:33.580575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:33.600157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:33.601366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:33.610065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1219/2397] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:26:33.631542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:33.642892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4b9c-44b3-4880-aea2-d05460778f27 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:33.648833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:33.649483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:33.649804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:33.650087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:33.659370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:33.660966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fc467-6ab8-43bc-8986-d501809d1503 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:33.670540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1179/2398] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:38.899516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:38.900934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:38.906716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=37 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:26:38.958853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e0e5-903e-4a24-a756-35f7bab7f033 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:38.962425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:38.963069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:38.963352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:38.963628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:38.973576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:38.975023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:38.985443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1220/2399] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:39.866901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2db9-22ae-409f-bee0-91c8f6623816 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:39.867480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2db9-22ae-409f-bee0-91c8f6623816 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:39.867480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f2db9-22ae-409f-bee0-91c8f6623816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:39.873993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=25 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:26:39.886984 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ca3f2db9-22ae-409f-bee0-91c8f6623816 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:39.888219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ca3f2db9-22ae-409f-bee0-91c8f6623816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:39.897391 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1180/2400] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:26:39.917591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:39.930920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a4e6-699a-4b1f-bb80-4aafc9cf675c service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:39.936526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:39.937176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:39.937467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:39.937919 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:39.947583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:39.949212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:39.959037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1221/2401] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:44.167465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa844c-3ff2-450a-baac-0c66d5ab71a6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:44.168086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa844c-3ff2-450a-baac-0c66d5ab71a6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:44.168086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa844c-3ff2-450a-baac-0c66d5ab71a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:44.188046 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-64fa844c-3ff2-450a-baac-0c66d5ab71a6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:26:44.189318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-64fa844c-3ff2-450a-baac-0c66d5ab71a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:26:44.198257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1181/2402] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:26:44.225882 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:26:44.237747 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b19aa-ee92-4763-99a2-a4174e8152a8 service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:26:44.244219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:26:44.244861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:26:44.245150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:26:44.245429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:26:44.254385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:26:44.255982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab2318-51ba-4c73-96b2-a96f51965d3d service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:26:44.265463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1222/2403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:26:54.181849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:26:54.261183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=37 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:27:04.649826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccc1e-6805-40f5-9363-0aaa65d03666 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:04.650323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccc1e-6805-40f5-9363-0aaa65d03666 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:04.650435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dccc1e-6805-40f5-9363-0aaa65d03666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:04.669156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a3dccc1e-6805-40f5-9363-0aaa65d03666 None None] MFA Rules not processed for user `4fb7a817f9e543f9958460d3c11595c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:04.670407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a3dccc1e-6805-40f5-9363-0aaa65d03666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:04.725941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1182/2404] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:14.718545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=25 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:27:17.711757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:17.711757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:17.711757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:17.728843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] MFA Rules not processed for user `839cacebadc44567b6a818f762ec0f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:17.730285 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:17.790592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1223/2405] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:27:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:27.395276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039756c-f74b-49b4-999d-b5fe523f2a0c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:27.395874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039756c-f74b-49b4-999d-b5fe523f2a0c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:27.395874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039756c-f74b-49b4-999d-b5fe523f2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:27.416283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-2039756c-f74b-49b4-999d-b5fe523f2a0c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:27.417466 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2039756c-f74b-49b4-999d-b5fe523f2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:27.425816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1183/2406] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:27.449090 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:27.450495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:27.466995 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a549cb-574e-4782-b5b5-545c24a01a66 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:27.472435 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:27.473187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:27.473476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:27.473779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:27.481969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:27.483579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:27.493212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1224/2407] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:31.884988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f72e-faea-400b-941e-f808453f5b9d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:31.885592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f72e-faea-400b-941e-f808453f5b9d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:31.885592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f72e-faea-400b-941e-f808453f5b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:31.904269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6628f72e-faea-400b-941e-f808453f5b9d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:31.905470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6628f72e-faea-400b-941e-f808453f5b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:31.915090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1184/2408] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:31.935465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:31.946880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae3bc-a29d-4a9f-8181-9ece008e87ca service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:31.952490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:31.953133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:31.953422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:31.953752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:31.962364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:31.963970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:31.973962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1225/2409] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:35.888170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1f79-1df3-4987-94b2-f04e6c4c49aa None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:35.888695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1f79-1df3-4987-94b2-f04e6c4c49aa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:35.888695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1f79-1df3-4987-94b2-f04e6c4c49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:35.907056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-292d1f79-1df3-4987-94b2-f04e6c4c49aa None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:35.908855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-292d1f79-1df3-4987-94b2-f04e6c4c49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:35.917426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1185/2410] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:35.945839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:35.957706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583744f-a5be-42c5-8153-702deb8bbe90 service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:35.963570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:35.964218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:35.964506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:35.964783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:35.974271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:35.975868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:35.985821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1226/2411] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:41.153966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:41.154500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:41.154500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:41.174498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:41.175720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:41.183802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1186/2412] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:27:41.209826 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:41.222403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb1cb-9e9b-4c55-bca6-28b3eae68e1b service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:41.228197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:41.228852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:41.229139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:41.229420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:41.239860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:41.241494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09060-d080-4bf1-bfed-240baf440d29 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:41.255058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1227/2413] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:44.716355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:44.718065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:44.781921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32593fb-5712-4682-8b5f-aa93124cedcf None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:44.786470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:44.787121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:44.787406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:44.787683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:44.789611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:44.804754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:44.806240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:44.817185 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1187/2414] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:46.496311 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:46.497693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:46.497693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:46.503788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=50 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:27:46.517136 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:27:46.518739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:46.527054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1228/2415] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:27:46.530778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:46.541361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce7c4a-8f9f-4a4c-95a5-d4f5fce10579 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:46.545022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:46.545706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:46.545994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:46.546282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:46.548080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:46.559959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:46.568395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:46.570561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:46.576357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497756-3ab4-43f4-9160-fc8b165bd3ba None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:46.584181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:46.584990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:46.585415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:46.585858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:46.587163 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1188/2416] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:46.601885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:46.604905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcead8-9c66-474a-8ed6-f41bae4fa2a5 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:46.621179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1229/2417] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:27:48.909632 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:27:48.923107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d61c98-e96b-4408-9907-b1f8de5755f4 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:27:48.929257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:27:48.929942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:27:48.930230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:27:48.930506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:27:48.932325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:27:48.943875 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:27:48.945461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:27:48.955086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1189/2418] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:27:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:27:56.613013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:27:58.950551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=50 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:08.083583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:08.084117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:08.084117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:08.102352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] MFA Rules not processed for user `dd736a7cc9ef4e8787af2edc928dee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:28:08.103656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:08.111621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1230/2419] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:28:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:28:08.435241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:08.445602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618ba1-8414-492d-862e-e67985a04086 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:08.449171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:08.449976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:08.450262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:08.450539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:08.452315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:08.463147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:08.464587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:08.473272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1190/2420] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:08.904338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:08.906822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:08.992847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66614322-fa2b-41e9-9ef6-bb29e3f0f891 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:08.997782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:08.998428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:08.998710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:08.998981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:09.001101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:09.013605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:09.015207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:09.028897 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1231/2421] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:11.943939 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:11.954911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d0f30-f700-4040-b621-33c54ad86828 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:11.975394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:11.975394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:11.975394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:11.975394 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:11.976917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:11.990080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:11.991568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:12.000994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1191/2422] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:12.893540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:12.912217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b014-89af-4b0d-bb76-55849f072728 service placement] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:12.923555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:12.926707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:12.926707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:12.926707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:12.927098 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:12.942068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:12.943698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:12.955638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1232/2423] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:21.996739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=12 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:22.950709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=41 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:26.666140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:26.677865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf53ed-a79e-48e5-8514-f5d077c16213 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:26.683131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:26.683876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:26.684156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:26.684623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:26.686595 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:26.700097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:26.702053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:26.713402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1192/2424] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:26.843606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:26.843606 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:26.862130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897042ad-da1c-4413-bfe3-8b7fadc9b8fc service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:26.867485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:26.868524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:26.868843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:26.869226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] PATH_INFO: `/v3/users/4fb7a817f9e543f9958460d3c11595c3` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:26.870679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb7a817f9e543f9958460d3c11595c3)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:26.872817 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:27.091756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb7a817f9e543f9958460d3c11595c3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.104670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb7a817f9e543f9958460d3c11595c3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.105440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb7a817f9e543f9958460d3c11595c3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.106089 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb7a817f9e543f9958460d3c11595c3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.114070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb7a817f9e543f9958460d3c11595c3'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.190623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1233/2425] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:28:26 2022] DELETE /identity/v3/users/4fb7a817f9e543f9958460d3c11595c3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:28:27.488718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:27.502748 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e656a-090f-4dfb-9a1e-543daad7d7dc service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:27.567414 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:27.568321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:27.568611 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:27.568908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] PATH_INFO: `/v3/projects/e64a9121bbbf4329a56e25cdd49ffdad` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:27.570152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64a9121bbbf4329a56e25cdd49ffdad)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:27.572102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:27.700445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64a9121bbbf4329a56e25cdd49ffdad', 'request_id': 'req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.778051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64a9121bbbf4329a56e25cdd49ffdad', 'request_id': 'req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.785618 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64a9121bbbf4329a56e25cdd49ffdad', 'request_id': 'req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.797709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] The token cache is being invalidate because project e64a9121bbbf4329a56e25cdd49ffdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:28:27.797998 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.798652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:28:27.800240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1193/2426] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:28:27 2022] DELETE /identity/v3/projects/e64a9121bbbf4329a56e25cdd49ffdad => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:28:32.037492 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:32.040146 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:32.099376 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb183-24ca-4ab0-83c1-6535fb60e373 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:32.153760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:32.154441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:32.154726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:32.155009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:32.156874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:32.208735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:32.225383 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:32.226856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9b6b-5ab9-446f-b82a-ae2343f65ef1 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:32.236891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1234/2427] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:34.964757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:34.966599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:34.980529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab3ee-103e-4cc5-8ac3-3633a15e50a8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:34.985005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:34.985731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:34.986023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:34.986306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:34.988272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:35.058807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:35.060259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:35.070539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1194/2428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:42.326498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:45.066084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:47.688264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:47.690564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:47.690564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:47.706913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] MFA Rules not processed for user `9b15d9e501344d88ab195ba16f569a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:28:47.708130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:47.715057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1235/2429] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:28:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:28:48.029073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:48.031220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:48.087930 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eeb35-d5f6-4bb3-9308-dfb651009087 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:48.091676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:48.092895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:48.093412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:48.093758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:48.095568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:48.105953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:48.107614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:48.115706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1195/2430] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:28:57.701852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:58.112132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=26 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:28:58.454107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:28:58.464122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ef36-e65e-442e-87e8-f5bfb3546fc6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:28:58.468062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:28:58.468707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:28:58.468990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:28:58.469264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:28:58.471092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:28:58.535344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:28:58.536784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:28:58.547154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1236/2431] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:01.288327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:01.290113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:01.376339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7a2-26d7-4520-a5c9-290a8d4f0b9d service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:01.382546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:01.385526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:01.385526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:01.385526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:01.385900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:01.400475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:01.404922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:01.416412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1196/2432] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:02.716261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:02.719598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:02.731709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d284844-bcdc-4403-92dc-62b63119a8cc service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:02.737068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:02.737989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:02.738277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:02.738556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] PATH_INFO: `/v3/users/839cacebadc44567b6a818f762ec0f5e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:02.739760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839cacebadc44567b6a818f762ec0f5e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:02.741727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:02.911596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839cacebadc44567b6a818f762ec0f5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:02.923980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839cacebadc44567b6a818f762ec0f5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:02.924689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839cacebadc44567b6a818f762ec0f5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:02.925293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839cacebadc44567b6a818f762ec0f5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:02.931936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d2d3cdf0-b258-4340-b0ce-c73355e416e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839cacebadc44567b6a818f762ec0f5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:02.989144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1237/2433] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:29:02 2022] DELETE /identity/v3/users/839cacebadc44567b6a818f762ec0f5e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:29:03.222038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.239662 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd38d3-1fbd-4ec6-81a6-8bd822178de2 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:03.308250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:03.309131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.309411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.309721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] PATH_INFO: `/v3/projects/7eed65f12fce4882badd262601e7c59e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.311447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eed65f12fce4882badd262601e7c59e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:03.315917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:03.407478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eed65f12fce4882badd262601e7c59e', 'request_id': 'req-c3c7506f-35c4-4d03-8c54-75369b4590dd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:03.474515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eed65f12fce4882badd262601e7c59e', 'request_id': 'req-c3c7506f-35c4-4d03-8c54-75369b4590dd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:03.480728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eed65f12fce4882badd262601e7c59e', 'request_id': 'req-c3c7506f-35c4-4d03-8c54-75369b4590dd'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:03.492507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] The token cache is being invalidate because project 7eed65f12fce4882badd262601e7c59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:29:03.496241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:03.496241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c3c7506f-35c4-4d03-8c54-75369b4590dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:29:03.496241 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1197/2434] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:29:03 2022] DELETE /identity/v3/projects/7eed65f12fce4882badd262601e7c59e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:29:03.500785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.501154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.501444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.521184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:03.522436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:03.583547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1238/2435] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:03.591188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.591476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.591804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.609807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:03.611030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:03.618867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1198/2436] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:03.623724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.633684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84fc3b-a717-4d95-a3e1-2be7a2fd8242 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:03.638353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:03.639672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.639977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.640233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.640987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:29:03.641300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:03.643008 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:03.644623 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:03.656415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1239/2437] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:29:03.660682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.672383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1edf74-b76b-492e-ba6a-ca44eaf8dee8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:03.678464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:03.679196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.679431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.679706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.680412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:03.682387 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:03.688030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:03.786083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1199/2438] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:29:03 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:29:03.790513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.801182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e3981-2624-435b-8fcb-e801b3968774 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:03.859197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:03.859869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.860161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.860441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.861292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:03.863349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:03.945151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1240/2439] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:29:03 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:29:03.949519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.960780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba36b4-91f1-48ae-9893-0f87b77a0f34 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:03.966112 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:03.967341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:03.967882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:03.968166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:03.968961 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:03.970693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:03.981690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1200/2440] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:29:03.986232 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:03.997213 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27eb54-af6d-4f5f-ab15-26cfb6ba2f0b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:04.002145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:04.002808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:04.003125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:04.003404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:04.004184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:04.005811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242a9c-909c-4f07-b03d-570e4d2aab89 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:04.016150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1241/2441] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:29:04.020543 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:04.031567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a7c7-ec59-4ae0-ac21-e32f20aad142 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:04.036339 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:04.037218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:04.037511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:04.037835 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] PATH_INFO: `/v3/projects/6315f0cda7d442c4a345d2015bb48642/users/e34d5f6de8f64902b3126e4d464d34a3/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:04.053707 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6315f0cda7d442c4a345d2015bb48642, user_id=e34d5f6de8f64902b3126e4d464d34a3, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:04.056409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:04.115593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1201/2442] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:29:04 2022] PUT /identity/v3/projects/6315f0cda7d442c4a345d2015bb48642/users/e34d5f6de8f64902b3126e4d464d34a3/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:29:04.120482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:04.120783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:04.121069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:04.139778 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:04.142506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:04.202373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1242/2443] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:04.212060 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:04.213767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:04.273958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bfafd-66f7-47fb-b63f-56f0ef5da53a admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:04.278732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:04.279957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:04.280271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:04.280575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:04.290545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:04.291994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906a7c-2372-42bf-b805-2a2dce02694c service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:04.309917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1202/2444] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:05.637328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:05.640104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:05.737380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf868-520c-4131-8f55-a1d3c3970a5f None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:05.750950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:05.751757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:05.752099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:05.752625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:05.755443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:05.770226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:05.772204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:05.778106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:05.786148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1243/2445] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:09.882369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619638-3faf-4f9f-8172-1e0e410a4371 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:09.882912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619638-3faf-4f9f-8172-1e0e410a4371 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:09.883377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619638-3faf-4f9f-8172-1e0e410a4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:09.913640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-79619638-3faf-4f9f-8172-1e0e410a4371 None None] MFA Rules not processed for user `e34d5f6de8f64902b3126e4d464d34a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:09.914843 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-79619638-3faf-4f9f-8172-1e0e410a4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:09.992337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1203/2446] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:10.006902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:10.008357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:10.024079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6c60-2940-4f45-823c-b0119d9b7a22 service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:10.032428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:10.033102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:10.033406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:10.033698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:10.042206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:10.043841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012401b-6be1-43ed-bc75-3f18b33fcc42 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:10.053835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1244/2447] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:29:12.385000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff55d-e9ba-4c7a-b759-98e1e5c379cc None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:12.385487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff55d-e9ba-4c7a-b759-98e1e5c379cc None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:12.385638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff55d-e9ba-4c7a-b759-98e1e5c379cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:12.409125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9e8ff55d-e9ba-4c7a-b759-98e1e5c379cc None None] MFA Rules not processed for user `e34d5f6de8f64902b3126e4d464d34a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:12.410393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9e8ff55d-e9ba-4c7a-b759-98e1e5c379cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:12.421435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1204/2448] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:20.049261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=7 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:22.400342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:36.139909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d9c1-9075-4cf5-9d06-53c09e29536e None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.141099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d9c1-9075-4cf5-9d06-53c09e29536e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.141099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d9c1-9075-4cf5-9d06-53c09e29536e None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.142562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1245/2449] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:29:36.148431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd0ea-4efd-49eb-8fb2-62fa055e9950 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.148926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd0ea-4efd-49eb-8fb2-62fa055e9950 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.149027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd0ea-4efd-49eb-8fb2-62fa055e9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.168090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8fbdd0ea-4efd-49eb-8fb2-62fa055e9950 None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:36.169316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8fbdd0ea-4efd-49eb-8fb2-62fa055e9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:36.176170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1205/2450] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:36.188568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3d9c1-9075-4cf5-9d06-53c09e29536e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:36.199369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3d9c1-9075-4cf5-9d06-53c09e29536e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:36.203641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:36.204979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.204979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.204979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.213685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:36.213804 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dc75f-d9ed-434f-bba6-8a7dd7c8ba6e service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:36.222093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1246/2451] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:36.307563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.307924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.308272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.309768 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1206/2452] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:29:36.315666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd8eb-4516-4a5b-825a-ccc8fc3330fb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.315959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd8eb-4516-4a5b-825a-ccc8fc3330fb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.316240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd8eb-4516-4a5b-825a-ccc8fc3330fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.334993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-82dbd8eb-4516-4a5b-825a-ccc8fc3330fb None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:36.336198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-82dbd8eb-4516-4a5b-825a-ccc8fc3330fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:36.345618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1247/2453] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:29:36.356001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:29:36.357823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:36.377204 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3940-87a6-4d88-b5b8-eb575bf8f9a3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:29:36.380983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:29:36.381668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:36.381955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:36.382230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:36.393306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:29:36.394837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:29:36.405898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1207/2454] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:29:46.329864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=9 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:46.401320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=9 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:29:56.286799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:29:56.289519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:29:56.289519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:29:56.305912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] MFA Rules not processed for user `dd736a7cc9ef4e8787af2edc928dee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:29:56.307281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:29:56.363277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1248/2455] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:30:06.355898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=25 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:30:54.232431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:30:54.234085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:30:54.415645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13010f-a8e5-4a2c-8d69-502d4fb6a082 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:30:54.421097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:30:54.421793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:30:54.422084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:30:54.422360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:30:54.424178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:30:54.437158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:30:54.438752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:30:54.454511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1208/2456] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:30:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:00.890530 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:00.917980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4d42-aa03-4cb7-bebb-5abe2d82ef09 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:00.923355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:00.923355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:00.923355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:00.923355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:00.925103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:00.960928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:00.962548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:00.983357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1249/2457] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:04.446806 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=63 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:04.642742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:04.645013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:04.658485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c6b5-fea0-476b-af57-25c9680dfce5 service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:04.663727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:04.664431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:04.664814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:04.665148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:04.667575 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:04.679793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:04.682066 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:04.692441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1209/2458] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:31:04.784142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:04.786425 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:04.800917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5b0b-6474-4fb9-a6c1-837b98e49a7e service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:04.807488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:04.808533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:04.808769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:04.809042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] PATH_INFO: `/v3/users/9b15d9e501344d88ab195ba16f569a3c` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:04.810316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b15d9e501344d88ab195ba16f569a3c)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:04.812385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:04.990336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b15d9e501344d88ab195ba16f569a3c'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.002874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b15d9e501344d88ab195ba16f569a3c'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.003548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b15d9e501344d88ab195ba16f569a3c'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.004153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b15d9e501344d88ab195ba16f569a3c'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.011174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1e827819-7926-49a1-b976-9ed744d27703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b15d9e501344d88ab195ba16f569a3c'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.066987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1250/2459] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:04 2022] DELETE /identity/v3/users/9b15d9e501344d88ab195ba16f569a3c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:05.354968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:05.365550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a87ff-0c5f-416d-b9f0-37510b8a6b04 service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:05.428812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:05.429723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:05.430009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:05.430288 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] PATH_INFO: `/v3/projects/7e3a8ff9ad9648d4b825437d1fcf8e5a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:05.431482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3a8ff9ad9648d4b825437d1fcf8e5a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:05.434194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:05.570244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3a8ff9ad9648d4b825437d1fcf8e5a', 'request_id': 'req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.678478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3a8ff9ad9648d4b825437d1fcf8e5a', 'request_id': 'req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.684790 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3a8ff9ad9648d4b825437d1fcf8e5a', 'request_id': 'req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.695864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] The token cache is being invalidate because project 7e3a8ff9ad9648d4b825437d1fcf8e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:05.696301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.696784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-0d3e68d4-32fd-4eae-b57e-fbe65c6a4cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:05.699273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1210/2460] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:05 2022] DELETE /identity/v3/projects/7e3a8ff9ad9648d4b825437d1fcf8e5a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:05.704003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:05.704219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:05.704505 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:05.764845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:05.766086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:05.812177 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:05.829724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1251/2461] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:05.838108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:05.839085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:05.839405 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:05.858083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:05.859284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:05.867224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1211/2462] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:05.871638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:05.882186 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3cec-fffd-45dc-9ee9-a5c0a47340e5 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:05.887165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:05.888308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:05.888308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:05.888626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:05.889107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:05.889508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:05.891165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:05.904360 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1252/2463] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 09:31:05.908314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:05.920484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114605f-c61f-4efb-98aa-0f48778b00be None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:05.925281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:05.925977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:05.926263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:05.926541 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:05.927244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:05.929203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.015511 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1212/2464] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:05 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:06.016940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.030668 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823bac0-fb7e-4b72-849a-9504b6f379c2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.089408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.090038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.090319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.090591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.091269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.093174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.170643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1253/2465] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:06 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:06.174969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.185793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989c0f-6e0a-4270-ab88-da58b44a3be9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.190357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.191008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.191314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.191567 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.192290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.193900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.205177 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1213/2466] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:06.209321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.220086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5019c-0e03-4a87-a84e-159e3c8e8547 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.224712 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.225366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.225689 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.225976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.226738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.228329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2237e-dd04-47ab-b8ce-6976d5406526 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.238156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1254/2467] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:06.242471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.253053 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa68f5d-53ad-4cae-9a2d-438af94f9b23 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.257805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.258714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.259003 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.259304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] PATH_INFO: `/v3/projects/ae962ad4ac9f4708844ae986c1e785e0/users/0472cb0dd04e423b8652aea1e0313547/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.275283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae962ad4ac9f4708844ae986c1e785e0, user_id=0472cb0dd04e423b8652aea1e0313547, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.278624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.374675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1214/2468] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:06 2022] PUT /identity/v3/projects/ae962ad4ac9f4708844ae986c1e785e0/users/0472cb0dd04e423b8652aea1e0313547/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:06.381084 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.381377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.381691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.408295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] MFA Rules not processed for user `0472cb0dd04e423b8652aea1e0313547`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:06.409496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:06.473105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1255/2469] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:06.477637 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.491221 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:06.541059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf807fd-c7c9-47f5-90c0-87aec51b7163 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.545910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.546570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.546852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.547125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.547808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.549766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.657699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1215/2470] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:06 2022] POST /identity/v3/projects => generated 403 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:06.661936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.673850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d57c4-872c-4097-9c93-0e520f1a0ad3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.714619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:06.730955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.731637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.732043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.732333 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.733028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.735004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.821839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1256/2471] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:06 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:06.825997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.836724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65134-7de2-4940-ac88-158fb5fd7306 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.841675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.842350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.842638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.842945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.843678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.845279 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.857068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1216/2472] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:06.861269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.872106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8c9c-3d7a-487b-a0f6-ba0a8d2e344d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:06.876684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:06.877584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:06.877891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:06.878168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] PATH_INFO: `/v3/projects/07cc280e10da46688212aa8c0e562da9/users/1cc380a8daf9495882864fe7cbbc0f96/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:06.893388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cc280e10da46688212aa8c0e562da9, user_id=1cc380a8daf9495882864fe7cbbc0f96, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:06.896052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:06.963120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1257/2473] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:06 2022] PUT /identity/v3/projects/07cc280e10da46688212aa8c0e562da9/users/1cc380a8daf9495882864fe7cbbc0f96/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:06.967142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:06.977301 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7505-4469-4ec4-bcad-7aab99a30470 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:07.035819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:07.036488 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.036778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.037059 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.037819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:07.039416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30ebdb-a84a-44d9-a1b6-37cfd7e6f680 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:07.049911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1217/2474] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:07.054040 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:07.065036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65643-2622-444a-ae2e-faae0939960c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:07.069796 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:07.070683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.070966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.071242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] PATH_INFO: `/v3/projects/07cc280e10da46688212aa8c0e562da9/users/1cc380a8daf9495882864fe7cbbc0f96/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.073318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cc280e10da46688212aa8c0e562da9, user_id=1cc380a8daf9495882864fe7cbbc0f96, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:07.075953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:07.086949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1258/2475] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:07 2022] PUT /identity/v3/projects/07cc280e10da46688212aa8c0e562da9/users/1cc380a8daf9495882864fe7cbbc0f96/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:07.097853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.098213 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.098648 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.126751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] MFA Rules not processed for user `1cc380a8daf9495882864fe7cbbc0f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:07.127999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:07.202195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1218/2476] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:07.215083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:07.216739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:07.296415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b520-dd39-4990-bc22-f18ab0ab1653 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:07.300434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:07.301268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.301630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.301875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.312288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:07.313763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418a74-5100-4c00-8946-558073f9aab9 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:07.323920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1259/2477] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:07.466669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:07.476267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:07.531162 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f28b-4ad2-468a-99e3-6ea556697b84 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:07.536329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:07.537206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.537490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.537796 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] PATH_INFO: `/v3/users/0472cb0dd04e423b8652aea1e0313547` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.539126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0472cb0dd04e423b8652aea1e0313547)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:07.541049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:07.773287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0472cb0dd04e423b8652aea1e0313547'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:07.773963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0472cb0dd04e423b8652aea1e0313547'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:07.774557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0472cb0dd04e423b8652aea1e0313547'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:07.782141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0472cb0dd04e423b8652aea1e0313547'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:07.849851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0472cb0dd04e423b8652aea1e0313547'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:07.867882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1219/2478] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:07 2022] DELETE /identity/v3/users/0472cb0dd04e423b8652aea1e0313547 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:07.873244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:07.873739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:07.877685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:07.891888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:07.893132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:07.951849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1260/2479] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:07.963180 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:07.965131 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:08.035121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb63b-182c-42e6-8509-e57fb0ac30fe admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:08.038822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:08.039475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:08.039764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:08.040047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:08.050110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:08.051562 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:08.063193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1220/2480] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:08.507920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:08.509300 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:08.521970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22abcd-82bd-476f-9a51-2679e66ebc0a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:08.528043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:08.528945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:08.529230 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:08.529507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] PATH_INFO: `/v3/projects/ae962ad4ac9f4708844ae986c1e785e0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:08.530749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae962ad4ac9f4708844ae986c1e785e0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:08.532739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:08.546179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:08.690529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae962ad4ac9f4708844ae986c1e785e0', 'request_id': 'req-e8b493fb-d00e-4771-8e0e-477dd99d80d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:08.696038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae962ad4ac9f4708844ae986c1e785e0', 'request_id': 'req-e8b493fb-d00e-4771-8e0e-477dd99d80d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:08.787405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae962ad4ac9f4708844ae986c1e785e0', 'request_id': 'req-e8b493fb-d00e-4771-8e0e-477dd99d80d2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:08.800374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] The token cache is being invalidate because project ae962ad4ac9f4708844ae986c1e785e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:08.800664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:08.801395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:08.803281 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1261/2481] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:08 2022] DELETE /identity/v3/projects/ae962ad4ac9f4708844ae986c1e785e0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:08.807635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:08.818457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd7464-e8da-41ae-ac55-5d02f2e20d77 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:08.836719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:08.878542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:08.879429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:08.879723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:08.879989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] PATH_INFO: `/v3/users/1cc380a8daf9495882864fe7cbbc0f96` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:08.881197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc380a8daf9495882864fe7cbbc0f96)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:08.883233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:09.063864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc380a8daf9495882864fe7cbbc0f96'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.064523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc380a8daf9495882864fe7cbbc0f96'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.065130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc380a8daf9495882864fe7cbbc0f96'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.072536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc380a8daf9495882864fe7cbbc0f96'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.140439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1ac5f9e3-ebd9-46b8-8cf0-4b2f419cab19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc380a8daf9495882864fe7cbbc0f96'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.160874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1221/2482] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:08 2022] DELETE /identity/v3/users/1cc380a8daf9495882864fe7cbbc0f96 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:09.563073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:09.564594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:09.581725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b493fb-d00e-4771-8e0e-477dd99d80d2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:09.658096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:09.659021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:09.659306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:09.659582 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] PATH_INFO: `/v3/projects/07cc280e10da46688212aa8c0e562da9` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:09.660822 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cc280e10da46688212aa8c0e562da9)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:09.662758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:09.775605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cc280e10da46688212aa8c0e562da9', 'request_id': 'req-5d5fc379-114d-4bb3-8326-cc1da746c824'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.786414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cc280e10da46688212aa8c0e562da9', 'request_id': 'req-5d5fc379-114d-4bb3-8326-cc1da746c824'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.861322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cc280e10da46688212aa8c0e562da9', 'request_id': 'req-5d5fc379-114d-4bb3-8326-cc1da746c824'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.880355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] The token cache is being invalidate because project 07cc280e10da46688212aa8c0e562da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:09.880355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.880355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5d5fc379-114d-4bb3-8326-cc1da746c824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:09.880355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1262/2483] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:09 2022] DELETE /identity/v3/projects/07cc280e10da46688212aa8c0e562da9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:09.882895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:09.883383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:09.883383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:09.903489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:09.904813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:09.968583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1222/2484] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:09.976453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:09.976741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:09.977022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:09.999197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:10.000469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:10.008979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1263/2485] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:10.013640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.023891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2e00-3a0d-424c-b8fa-b75374f6223d None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.029224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.029923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.030237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.030519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.031986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:10.032365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.034015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.047650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1223/2486] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:10.052219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.063493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f5e73-a687-479b-bf2d-a8d0b465de7d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.068475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.069140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.069423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.069762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.070466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.072506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.179948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1264/2487] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:10 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:10.182004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.193519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b2bc9-cefb-4fc6-9eb8-eaea2a8af782 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.219408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:10.253102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.253811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.254099 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.254407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.255108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.257055 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.352532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1224/2488] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:10 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:10.357166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.365022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:10.370686 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ff0d0-e2f3-40d6-bbd0-462354622f5b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.375698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.376372 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.378970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.378970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.378970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.379284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.390340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1265/2489] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:10.394473 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.406744 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612890-611f-4bad-9df4-0e2dac9d2903 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.411742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.412420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.412709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.412987 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.413777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.415464 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74e9f-6b56-4e7f-9e1e-f2d39d548598 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.427088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1225/2490] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:10.431391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.441682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a36be-3f54-4e37-932b-eea4a7ad05ca admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.446724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.448114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.448610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.448932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] PATH_INFO: `/v3/projects/f11552d834ae40be98fa4706fe34c928/users/b92553bab8f14c6d9c64b35f0adf3e57/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.465469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11552d834ae40be98fa4706fe34c928, user_id=b92553bab8f14c6d9c64b35f0adf3e57, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.468483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.571418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1266/2491] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:10 2022] PUT /identity/v3/projects/f11552d834ae40be98fa4706fe34c928/users/b92553bab8f14c6d9c64b35f0adf3e57/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:10.582760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.583293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.583580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.612909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] MFA Rules not processed for user `b92553bab8f14c6d9c64b35f0adf3e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:10.614193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:10.687445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1226/2492] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:10.691993 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.769825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb015b-08de-46d7-b80e-95610dd24361 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.775364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.776369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.777211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.777555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.778353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.780437 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:10.889655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1267/2493] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:10 2022] POST /identity/v3/projects => generated 399 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:10.891264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:10.903331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153e16-0653-40b9-b2c3-d366c158e3a8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:10.963072 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:10.964184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:10.964325 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:10.964733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:10.965482 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:10.967570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.084823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1227/2494] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:10 2022] POST /identity/v3/users => generated 306 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:11.089843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.099847 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba43e2c-c074-4213-93c2-444f50b120f3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.104904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.105659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.105947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.106229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.107003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.108639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.120456 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1268/2495] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:11.124767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.135202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee304a-82fb-4709-a1c1-7689df15a079 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.141077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.142073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.142357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.142636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] PATH_INFO: `/v3/projects/01a505b9f082417380dd787b81e7c9f8/users/600879f2dcfb418f8b036c1fbf3bcbbe/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.159660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a505b9f082417380dd787b81e7c9f8, user_id=600879f2dcfb418f8b036c1fbf3bcbbe, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.162441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.227854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:11.233519 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1228/2496] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:11 2022] PUT /identity/v3/projects/01a505b9f082417380dd787b81e7c9f8/users/600879f2dcfb418f8b036c1fbf3bcbbe/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:11.237619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.248825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956f57b-0c1f-44a3-a618-74b6e7b49ec5 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.312639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.313328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.313670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.313954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.314723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.316335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad93bcd-6c80-4199-bf57-df17fb86119c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.327036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1269/2497] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:31:11.331295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.343135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372db9-434b-4d5d-ad20-a34a21480327 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.348020 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.348908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.349189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.349462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] PATH_INFO: `/v3/projects/01a505b9f082417380dd787b81e7c9f8/users/600879f2dcfb418f8b036c1fbf3bcbbe/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.351449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a505b9f082417380dd787b81e7c9f8, user_id=600879f2dcfb418f8b036c1fbf3bcbbe, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.354202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.365621 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1229/2498] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:11 2022] PUT /identity/v3/projects/01a505b9f082417380dd787b81e7c9f8/users/600879f2dcfb418f8b036c1fbf3bcbbe/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:11.377745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.378066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.378555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.407284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] MFA Rules not processed for user `600879f2dcfb418f8b036c1fbf3bcbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:11.408516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:11.439677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:11.486657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1270/2499] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:11.494413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.496882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:11.557967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d1aab-807b-4b79-a8f1-08253edf2cf8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.562136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.562800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.565214 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.565214 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.573462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.575047 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.585024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1230/2500] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:11.791834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:11.803468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c587-7abd-424b-b0e9-c949711f53a9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:11.807358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:11.808203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:11.808723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:11.809035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:11.875140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:11.876704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb2c08-9e19-4d06-80cf-db6f78399c9d service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:11.887925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1271/2501] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:16.980396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:17.045820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb680-a9c4-4c04-8610-d951e5bf783a service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:17.050547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:17.051448 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:17.051734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:17.052010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] PATH_INFO: `/v3/users/b92553bab8f14c6d9c64b35f0adf3e57` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:17.053189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92553bab8f14c6d9c64b35f0adf3e57)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:17.055176 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:17.216336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92553bab8f14c6d9c64b35f0adf3e57'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:17.216336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92553bab8f14c6d9c64b35f0adf3e57'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:17.216336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92553bab8f14c6d9c64b35f0adf3e57'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:17.222720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92553bab8f14c6d9c64b35f0adf3e57'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:17.284202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92553bab8f14c6d9c64b35f0adf3e57'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:17.303557 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1231/2502] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:16 2022] DELETE /identity/v3/users/b92553bab8f14c6d9c64b35f0adf3e57 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:17.308669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:17.309458 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:17.309762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:17.328235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:17.329440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:17.388382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1272/2503] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:17.398167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:17.399602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:17.410785 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:17.464501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c81b-0b48-444e-9eae-a05e335a8eaf admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:17.468276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:17.468895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:17.469181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:17.469461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:17.478898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:17.480993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:17.490928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1232/2504] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:17.955842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:17.957292 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:17.969998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d178b-731b-4a7b-aaa1-2056628058e8 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:17.974768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:17.975648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:17.975928 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:17.976198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] PATH_INFO: `/v3/projects/f11552d834ae40be98fa4706fe34c928` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:17.977403 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11552d834ae40be98fa4706fe34c928)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:17.979457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:18.112925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11552d834ae40be98fa4706fe34c928', 'request_id': 'req-d515f50c-313e-4e57-b2fe-3bff20ddf38e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.117439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:18.118743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11552d834ae40be98fa4706fe34c928', 'request_id': 'req-d515f50c-313e-4e57-b2fe-3bff20ddf38e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.181222 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11552d834ae40be98fa4706fe34c928', 'request_id': 'req-d515f50c-313e-4e57-b2fe-3bff20ddf38e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.192809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] The token cache is being invalidate because project f11552d834ae40be98fa4706fe34c928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:18.193100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.193767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.195357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1273/2505] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:17 2022] DELETE /identity/v3/projects/f11552d834ae40be98fa4706fe34c928 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:18.200284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:18.210495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4529a8-95bc-436f-a542-f0ad05cb356c service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:18.267666 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:18.268458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:18.268747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:18.269021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] PATH_INFO: `/v3/users/600879f2dcfb418f8b036c1fbf3bcbbe` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:18.270318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=600879f2dcfb418f8b036c1fbf3bcbbe)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:18.272254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:18.434931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600879f2dcfb418f8b036c1fbf3bcbbe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.435679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600879f2dcfb418f8b036c1fbf3bcbbe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.436421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600879f2dcfb418f8b036c1fbf3bcbbe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.444018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600879f2dcfb418f8b036c1fbf3bcbbe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.547023 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-13165dbc-0cf9-43c4-bf97-6d87ddace61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600879f2dcfb418f8b036c1fbf3bcbbe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:18.565228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1233/2506] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:18 2022] DELETE /identity/v3/users/600879f2dcfb418f8b036c1fbf3bcbbe => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:19.076959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.078463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:19.094573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.094873 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.095268 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.111620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515f50c-313e-4e57-b2fe-3bff20ddf38e admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.130052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:19.131730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:19.157593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:19.177936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.180010 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.180301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.180575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] PATH_INFO: `/v3/projects/01a505b9f082417380dd787b81e7c9f8` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.181831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a505b9f082417380dd787b81e7c9f8)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.184257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.206614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1234/2507] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:19.247982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.253124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:19.290636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a505b9f082417380dd787b81e7c9f8', 'request_id': 'req-6bf10133-9823-4469-8e00-7b819d925b71'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:19.297534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a505b9f082417380dd787b81e7c9f8', 'request_id': 'req-6bf10133-9823-4469-8e00-7b819d925b71'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:19.323956 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5a2b-38c1-4d0d-9adf-8889fca48ee1 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.386228 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.387086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.387383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.387660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.393082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a505b9f082417380dd787b81e7c9f8', 'request_id': 'req-6bf10133-9823-4469-8e00-7b819d925b71'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:19.405957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] The token cache is being invalidate because project 01a505b9f082417380dd787b81e7c9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:19.406330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:19.407027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6bf10133-9823-4469-8e00-7b819d925b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:19.412048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1274/2508] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:19 2022] DELETE /identity/v3/projects/01a505b9f082417380dd787b81e7c9f8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:19.413467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.413835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.414363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.432160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:19.433444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:19.444369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.446031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003fd03-10a8-4097-8f9b-d786b1328f49 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.455295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1235/2509] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 09:31:19.519080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1275/2510] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:31:19.528413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.528816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.533798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.540731 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:19.553955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:19.555184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:19.568463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1236/2511] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:31:19.571515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.590850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac203289-ec02-4fad-beb6-a9d68530a0f4 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.596485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.597537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.597957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.598355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.599258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:19.599585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.601258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.616896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1276/2512] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:19.621784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.632597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac5ec-5875-48ec-98bf-d3cf2037a821 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.638991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.639599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.639797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.640262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.641486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.643477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.706903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1237/2513] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:19 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:19.708395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.714078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:19.721044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986d92-fc62-4af3-8417-53af02bae19a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.788096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.788777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.789075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.789344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.790132 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.792805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.866405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1277/2514] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:19 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:31:19.870379 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.880844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bcb11-d490-4888-a458-b688639a8da0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.885539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.886428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.886714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.886992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.887749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.889338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.900011 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1238/2515] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:19.904519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.914346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704158f-a628-42fe-b409-8952210eeed6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.919851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.920501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.920788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.921073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.921827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.923422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8cef-cab2-4a04-9451-e898ca800651 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:19.933141 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1278/2516] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:19.937293 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:19.947282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a444-696c-4b20-93e2-db8c9bfb8057 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:19.952013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:19.952889 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:19.953170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:19.953535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] PATH_INFO: `/v3/projects/b05aa79cab634a599268a301d31992f1/users/f3c6b76f18054e4e9abf66c0b3519095/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:19.968585 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05aa79cab634a599268a301d31992f1, user_id=f3c6b76f18054e4e9abf66c0b3519095, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:19.971345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:20.058354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1239/2517] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:19 2022] PUT /identity/v3/projects/b05aa79cab634a599268a301d31992f1/users/f3c6b76f18054e4e9abf66c0b3519095/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:20.070275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59502-877d-4f38-acf2-336d931402af None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:20.070811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59502-877d-4f38-acf2-336d931402af None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:20.071327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59502-877d-4f38-acf2-336d931402af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:20.103765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-00e59502-877d-4f38-acf2-336d931402af None None] MFA Rules not processed for user `f3c6b76f18054e4e9abf66c0b3519095`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:20.106469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-00e59502-877d-4f38-acf2-336d931402af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:20.187587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1279/2518] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:20.191766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:20.271775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789e0c-f5ae-444b-99ad-c67cf8fde9e8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:20.279419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:20.280356 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:20.280813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:20.281135 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:20.281881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:20.283955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:20.396723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1240/2519] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:20 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:31:20.405716 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e59502-877d-4f38-acf2-336d931402af None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:20.418713 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e59502-877d-4f38-acf2-336d931402af None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:20.496052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:20.496052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:20.496052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:20.496052 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:20.496590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:20.498745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.057528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:21.063535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1280/2520] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:20 2022] POST /identity/v3/users => generated 301 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:21.071863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:21.108418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33013611-812d-4602-8489-a8343773f4d0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:21.122778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:21.123534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.123820 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.124101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.124840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:21.126479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.141833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1241/2521] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:21.146322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:21.165249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd1f3f-e2e1-4009-a06b-6590aece9fe6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:21.176808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:21.177886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.178337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.178650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] PATH_INFO: `/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c/users/888ec7372ecf476fa5e44c1c2903e555/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.202632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a55bcc7e8c4d8caf5cfbef45cd506c, user_id=888ec7372ecf476fa5e44c1c2903e555, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:21.205783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.414219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1281/2522] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:21 2022] PUT /identity/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c/users/888ec7372ecf476fa5e44c1c2903e555/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:21.417633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:21.437179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a43c00-86b4-4f2d-96f5-60177fa1280d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:21.521244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:21.522617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.527142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.527142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.527142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:21.530370 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9594a8-f6c1-4d53-b6ab-2ce949dde187 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.549154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1242/2523] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:21.553402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:21.566316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd356e-507f-4a35-9bed-3af314a485ec admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:21.572814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:21.573951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.574242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.574526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] PATH_INFO: `/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c/users/888ec7372ecf476fa5e44c1c2903e555/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.577429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a55bcc7e8c4d8caf5cfbef45cd506c, user_id=888ec7372ecf476fa5e44c1c2903e555, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:21.580166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.605338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1282/2524] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:21 2022] PUT /identity/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c/users/888ec7372ecf476fa5e44c1c2903e555/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:21.616533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.616819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.617120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.642592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:21.653065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] MFA Rules not processed for user `888ec7372ecf476fa5e44c1c2903e555`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:21.654409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:21.731967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1243/2525] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:21.742807 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:21.747192 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:21.829608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba07579-fbe4-4f61-9859-feee750af00c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:21.833313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:21.834160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:21.834497 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:21.835092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:21.845637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:21.847226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d5e11-bfe9-4b26-a69e-4de71f3b2459 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:21.859552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1283/2526] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:22.027697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:22.102410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947a4a-449e-4702-a66e-72d2d141eb7e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:22.109153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:22.110071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:22.110498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:22.110786 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] PATH_INFO: `/v3/users/f3c6b76f18054e4e9abf66c0b3519095` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:22.112111 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c6b76f18054e4e9abf66c0b3519095)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:22.114533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:22.486913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c6b76f18054e4e9abf66c0b3519095'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:22.487655 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c6b76f18054e4e9abf66c0b3519095'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:22.488190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c6b76f18054e4e9abf66c0b3519095'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:22.505751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c6b76f18054e4e9abf66c0b3519095'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:22.621646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c6b76f18054e4e9abf66c0b3519095'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:22.640547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1244/2527] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:22 2022] DELETE /identity/v3/users/f3c6b76f18054e4e9abf66c0b3519095 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:22.645479 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:22.646022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:22.646022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:22.665655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:22.667806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:22.750167 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1284/2528] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:22.757765 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:22.759314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:22.782115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:22.830828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f60fe-8df8-4f67-bab1-d9408eeaefad admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:22.834757 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:22.835463 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:22.835864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:22.835993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:22.849250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:22.850831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:22.862953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1245/2529] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:23.286195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:23.287646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:23.301024 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32157cd6-5302-4a52-baac-82dec9a18bf6 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:23.306776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:23.308237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:23.308611 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:23.308934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] PATH_INFO: `/v3/projects/b05aa79cab634a599268a301d31992f1` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:23.310217 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05aa79cab634a599268a301d31992f1)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:23.312144 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:23.439676 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05aa79cab634a599268a301d31992f1', 'request_id': 'req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.447042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05aa79cab634a599268a301d31992f1', 'request_id': 'req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.450523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:23.535461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05aa79cab634a599268a301d31992f1', 'request_id': 'req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.551556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] The token cache is being invalidate because project b05aa79cab634a599268a301d31992f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:23.551779 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.552418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.554097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1285/2530] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:23 2022] DELETE /identity/v3/projects/b05aa79cab634a599268a301d31992f1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:23.559493 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:23.571105 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23f933-06a2-47d6-a6c2-3e0db70b6863 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:23.647006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:23.648192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:23.648478 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:23.648755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] PATH_INFO: `/v3/users/888ec7372ecf476fa5e44c1c2903e555` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:23.650014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888ec7372ecf476fa5e44c1c2903e555)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:23.652594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:23.810631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888ec7372ecf476fa5e44c1c2903e555'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.811483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888ec7372ecf476fa5e44c1c2903e555'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.812752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888ec7372ecf476fa5e44c1c2903e555'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.825942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888ec7372ecf476fa5e44c1c2903e555'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.901629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e0a79db7-89f7-4e6e-ad94-1b0185be6404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888ec7372ecf476fa5e44c1c2903e555'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:23.938578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1246/2531] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:23 2022] DELETE /identity/v3/users/888ec7372ecf476fa5e44c1c2903e555 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:24.436234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:24.437893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:24.456559 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb97ff-9dec-493c-bfdb-cc6fb9f3277a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:24.547665 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:24.549384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:24.550218 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:24.550935 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] PATH_INFO: `/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:24.552767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a55bcc7e8c4d8caf5cfbef45cd506c)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:24.555377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:24.673596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a55bcc7e8c4d8caf5cfbef45cd506c', 'request_id': 'req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:24.680206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a55bcc7e8c4d8caf5cfbef45cd506c', 'request_id': 'req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:24.758274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a55bcc7e8c4d8caf5cfbef45cd506c', 'request_id': 'req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:24.772677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] The token cache is being invalidate because project b1a55bcc7e8c4d8caf5cfbef45cd506c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:24.772677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:24.774009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1ec1425-ca9d-4b2e-9b79-54fd5f7f4012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:24.775824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1286/2532] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:24 2022] DELETE /identity/v3/projects/b1a55bcc7e8c4d8caf5cfbef45cd506c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:24.781631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:24.782252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:24.782989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:24.810341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:24.812871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:24.859763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:24.903721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1247/2533] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:31:24.906929 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:24.907520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:24.907813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:24.928662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:24.929843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:24.941614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1287/2534] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:24.943903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:24.954578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7149-445d-4276-b0d8-b4e71d77d64a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:24.960449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:24.961191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:24.961548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:24.961926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:24.962730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:24.963128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:24.965188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:24.981009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1248/2535] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:24.984493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:24.996101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a46d-e3d4-452e-b58f-4bc8aee7feb9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:25.001408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:25.002301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.002433 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.002629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.003469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:25.005587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:25.105890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:25.113905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1288/2536] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:24 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:25.118128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf70d-b9cb-431d-b340-bc05e509912c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:25.276583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:25.276583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.276583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.276583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.278250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:25.278250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:25.748456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1249/2537] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:25 2022] POST /identity/v3/users => generated 305 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:25.752618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:25.763043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddbef-e3db-4e81-b988-19878a5d510d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:25.768910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:25.768910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.768910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.768910 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.769493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:25.771114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:25.782260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1289/2538] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:25.786455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:25.797369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168ba3a-f43c-4382-8a90-c3d6f49094fa admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:25.802039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:25.804704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.804704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.804704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.804704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:25.805695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d8e9-86b5-4fc8-91a8-e635a7113a00 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:25.817074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1250/2539] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:31:25.821209 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:25.831798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246999-f2ec-4044-9b74-ad2b667106c9 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:25.836519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:25.837411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.837745 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.838031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] PATH_INFO: `/v3/projects/90fed486befc47a88fbd326a72558462/users/9458b102b4ab4ebaa278fe9d4a7fd61f/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.855179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fed486befc47a88fbd326a72558462, user_id=9458b102b4ab4ebaa278fe9d4a7fd61f, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:25.858627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:25.940361 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1290/2540] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:25 2022] PUT /identity/v3/projects/90fed486befc47a88fbd326a72558462/users/9458b102b4ab4ebaa278fe9d4a7fd61f/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:25.943283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:25.943283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:25.943283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:25.976378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] MFA Rules not processed for user `9458b102b4ab4ebaa278fe9d4a7fd61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:25.978277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:26.062650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1251/2541] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:26.066879 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.090876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:26.157741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44938f-93c2-4e84-bd69-9ba559c49a01 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.162851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.166595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.166595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.166595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.166595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.167012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.253385 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1291/2542] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:26 2022] POST /identity/v3/projects => generated 407 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:26.257043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.270086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2603bd3-caf9-4037-b7e6-b399869095a5 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.327886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:26.362306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.363982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.364546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.365346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.366251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.368373 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.505888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1252/2543] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:26 2022] POST /identity/v3/users => generated 310 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:26.507131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.518422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462789a-c1a5-4eac-b1d1-0fe18c92a11a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.524934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.525651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.525948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.526760 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.527617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.529828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.543603 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1292/2544] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:26.553794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.565550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c92f-1390-43bc-a0fa-9915f07369d2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.572491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.574451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.581879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.581879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] PATH_INFO: `/v3/projects/e851c3b4439149c0a111d292140085ff/users/7a415fdd3cd44e6b8bae271a09ba0b05/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.594149 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e851c3b4439149c0a111d292140085ff, user_id=7a415fdd3cd44e6b8bae271a09ba0b05, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.597097 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.686730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1253/2545] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:26 2022] PUT /identity/v3/projects/e851c3b4439149c0a111d292140085ff/users/7a415fdd3cd44e6b8bae271a09ba0b05/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:26.690833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.708236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7526-f679-4c27-a66c-c34819128007 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.780512 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.781510 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.781723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.782049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.783166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.784774 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3f054-653a-4584-90fd-c05d582bc862 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.802937 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1293/2546] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:26.804074 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:26.820886 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b1ec-ee7d-4047-8d52-243968edd0b9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:26.827586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:26.828573 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.828996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.829281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] PATH_INFO: `/v3/projects/e851c3b4439149c0a111d292140085ff/users/7a415fdd3cd44e6b8bae271a09ba0b05/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.831935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e851c3b4439149c0a111d292140085ff, user_id=7a415fdd3cd44e6b8bae271a09ba0b05, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:26.834196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:26.847453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1254/2547] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:26 2022] PUT /identity/v3/projects/e851c3b4439149c0a111d292140085ff/users/7a415fdd3cd44e6b8bae271a09ba0b05/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:26.861039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:26.862467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:26.862467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:26.897648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] MFA Rules not processed for user `7a415fdd3cd44e6b8bae271a09ba0b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:26.899134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:26.991726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1294/2548] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:27.005678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:27.007601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:27.075038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2dce-80c5-4239-b4b8-593e6f8912b9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:27.078912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:27.079579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:27.079866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:27.080147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:27.092695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:27.094503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:27.104724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1255/2549] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:27.548432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:27.561063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ee2d3-fa33-4af0-8c95-1fdefb22d431 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:27.576306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:27.576976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:27.577264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:27.577542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:27.590175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:27.654294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:27.656389 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:27.672939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1295/2550] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:31:33.662251 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:33.663735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:33.722006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357dd1-d46c-4dcb-b7e3-e3d8e6b4ab70 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:33.725540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:33.726223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:33.726530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:33.726804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:33.728584 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:33.774004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:33.790745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:33.792602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac4f1f-b1bc-4545-ba7f-8a10b85b1e91 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:33.801631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1256/2551] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:35.855139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:35.925459 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0567b-ada1-42f8-9bf6-dc290dc07889 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:35.930122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:35.931059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:35.931349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:35.931638 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] PATH_INFO: `/v3/users/9458b102b4ab4ebaa278fe9d4a7fd61f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:35.933940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9458b102b4ab4ebaa278fe9d4a7fd61f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:35.935880 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:36.082077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9458b102b4ab4ebaa278fe9d4a7fd61f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:36.095439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9458b102b4ab4ebaa278fe9d4a7fd61f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:36.096009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9458b102b4ab4ebaa278fe9d4a7fd61f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:36.096628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9458b102b4ab4ebaa278fe9d4a7fd61f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:36.103815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9458b102b4ab4ebaa278fe9d4a7fd61f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:36.199128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1296/2552] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:35 2022] DELETE /identity/v3/users/9458b102b4ab4ebaa278fe9d4a7fd61f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:36.203838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576760-b0b6-4881-89f6-b3efcd5792aa None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.204318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576760-b0b6-4881-89f6-b3efcd5792aa None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.204404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576760-b0b6-4881-89f6-b3efcd5792aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.221872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-0a576760-b0b6-4881-89f6-b3efcd5792aa None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:36.223207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-0a576760-b0b6-4881-89f6-b3efcd5792aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:36.285891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1257/2553] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:36.295850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:36.297463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:36.334946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:36.367967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d2bd-1468-4302-9322-1f6780aec655 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:36.367967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:36.367967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.367967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.368494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.376863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:36.378352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041042-db92-4244-bd39-1d326d57294f service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:36.389615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1297/2554] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:36.536132 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.536457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.536745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.538158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1258/2555] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 09:31:36.545870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.546163 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.546443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.583255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:36.584524 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:36.667851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1298/2556] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:36.678938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:36.680681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:36.741812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0f8bc-34c9-4a30-a2ec-ac9d022bacbd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:36.746504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:36.747230 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.747613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.747899 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.758866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:36.760318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:36.771868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1259/2557] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:36.920270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:36.921801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:36.935544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2493e6-1c80-4d42-b126-4fba67a42f4b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:36.940298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:36.946602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:36.946906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:36.947185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] PATH_INFO: `/v3/projects/90fed486befc47a88fbd326a72558462` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:36.948455 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fed486befc47a88fbd326a72558462)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:36.950415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:37.068839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fed486befc47a88fbd326a72558462', 'request_id': 'req-adb94163-2b89-4ac6-a081-59eb9da5dd2a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.075000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fed486befc47a88fbd326a72558462', 'request_id': 'req-adb94163-2b89-4ac6-a081-59eb9da5dd2a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.118078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fed486befc47a88fbd326a72558462', 'request_id': 'req-adb94163-2b89-4ac6-a081-59eb9da5dd2a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.130119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] The token cache is being invalidate because project 90fed486befc47a88fbd326a72558462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:37.130646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.131255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.133059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1299/2558] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:36 2022] DELETE /identity/v3/projects/90fed486befc47a88fbd326a72558462 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:37.137524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:37.149184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd790d8-4f29-4319-a02f-d02fa0807a9d service glance] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:37.208385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:37.209198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:37.209481 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:37.209856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] PATH_INFO: `/v3/users/7a415fdd3cd44e6b8bae271a09ba0b05` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:37.211026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a415fdd3cd44e6b8bae271a09ba0b05)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:37.212949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:37.292201 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:37.380222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a415fdd3cd44e6b8bae271a09ba0b05'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.381256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a415fdd3cd44e6b8bae271a09ba0b05'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.382142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a415fdd3cd44e6b8bae271a09ba0b05'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.389278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a415fdd3cd44e6b8bae271a09ba0b05'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.499906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3321ff73-a21e-423e-a407-e1e73139332c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a415fdd3cd44e6b8bae271a09ba0b05'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:37.525802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1260/2559] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:37 2022] DELETE /identity/v3/users/7a415fdd3cd44e6b8bae271a09ba0b05 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:38.171673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:38.173165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:38.187869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb94163-2b89-4ac6-a081-59eb9da5dd2a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:38.219062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:38.273241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:38.274334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.274622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.274950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] PATH_INFO: `/v3/projects/e851c3b4439149c0a111d292140085ff` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.276865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e851c3b4439149c0a111d292140085ff)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:38.279139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:38.381805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e851c3b4439149c0a111d292140085ff', 'request_id': 'req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:38.390185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e851c3b4439149c0a111d292140085ff', 'request_id': 'req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:38.461533 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e851c3b4439149c0a111d292140085ff', 'request_id': 'req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:38.474889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] The token cache is being invalidate because project e851c3b4439149c0a111d292140085ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:38.475179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:38.475841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-2bd1ab3e-fa10-4f0a-a627-61f9cafbd13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:38.477364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1300/2560] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:38 2022] DELETE /identity/v3/projects/e851c3b4439149c0a111d292140085ff => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:38.482909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.483422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.483529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.502619 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:38.503863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:38.578896 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1261/2561] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:38.586767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.587062 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.587339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.608474 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:38.609834 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:38.617939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1301/2562] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:38.622321 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:38.632178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d792e1-e9c4-4241-b292-6e917cdd8c07 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:38.637224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:38.637912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.638196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.638471 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.639249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:38.639554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:38.641155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:38.657014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1262/2563] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:38.658139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:38.667959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442371e-f650-4b11-8227-2011c5874a1c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:38.673039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:38.673729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.674014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.674290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.675014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:38.677026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:38.787194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1302/2564] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:38 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:38.791461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:38.805209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526804-ad2c-4121-8f7a-6f3b51fa6370 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:38.871309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:38.872560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.872560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.876461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.876461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:38.876461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:38.962612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1263/2565] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:38 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:38.965864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:38.978887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e28d-6b9c-4b4a-a786-5735a60d5f96 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:38.984620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:38.985495 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:38.991326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:38.991326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:38.991326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:38.991326 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.000884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1303/2566] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:31:39.005542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.021763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278dc2-282d-41a1-a0f7-10532096707b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.028198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.029165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.029480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.029848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.030571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.032299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef668d8e-d24a-437f-bfe1-2bee2bface98 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.046397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1264/2567] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:31:39.050576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.064364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac3d0-8cb3-4e24-bd14-50ba4e04dae0 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.073871 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.074855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.075143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.075605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] PATH_INFO: `/v3/projects/ae5a5e5fbc344b6c9a026763b315d83f/users/65b01aace46044808953aef639a2c731/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.096142 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5a5e5fbc344b6c9a026763b315d83f, user_id=65b01aace46044808953aef639a2c731, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.099249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.195033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1304/2568] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:39 2022] PUT /identity/v3/projects/ae5a5e5fbc344b6c9a026763b315d83f/users/65b01aace46044808953aef639a2c731/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:39.207945 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.208229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.208689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.233501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:39.244714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] MFA Rules not processed for user `65b01aace46044808953aef639a2c731`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:39.246237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:39.332457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1265/2569] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:39.337286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.437304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:39.441358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ad83-e1da-45be-b0a7-f590399723e7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.451554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.452482 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.452766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.453182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.454185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.456619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.545387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1305/2570] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:31:39.551538 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.567700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f362b-4524-47fd-9352-ed4cad8d0ded None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.639450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.640133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.640416 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.640687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.641384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.643603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.757681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1266/2571] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:39 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:39.762769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.775174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf431-bb99-4c3f-b8c9-9367f0024706 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.780579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.781253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.781543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.781846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.782577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.784171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.796572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1306/2572] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:39.800745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.811308 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade780-accc-450d-a013-83de392197c5 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.816239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.817125 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.817410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.817881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] PATH_INFO: `/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d/users/2d6f29d780424887ae3dc47b0be069c6/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.833216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f64e9cadecd44b68434c0f53abe8a8d, user_id=2d6f29d780424887ae3dc47b0be069c6, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.835957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:39.919208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1267/2573] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:39 2022] PUT /identity/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d/users/2d6f29d780424887ae3dc47b0be069c6/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:39.923415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:39.933734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff09c-de1c-4121-8b72-b5ee7f75086b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:39.992018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:39.992700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:39.992985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:39.993260 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:39.994064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:39.995799 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8a344-f222-4b73-9e3f-bb724d1423ed admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:40.005939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1307/2574] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:40.010189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:40.021829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f908-ebb1-41c9-ac39-00c6a18057a8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:40.027921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:40.028716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:40.029083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:40.029465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] PATH_INFO: `/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d/users/2d6f29d780424887ae3dc47b0be069c6/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:40.031599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f64e9cadecd44b68434c0f53abe8a8d, user_id=2d6f29d780424887ae3dc47b0be069c6, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:40.034393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:40.045866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1268/2575] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:40 2022] PUT /identity/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d/users/2d6f29d780424887ae3dc47b0be069c6/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:40.056183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:40.056475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:40.056754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:40.093820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] MFA Rules not processed for user `2d6f29d780424887ae3dc47b0be069c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:40.093820 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:40.160627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1308/2576] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:40.173900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:40.175613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:40.270734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd225-0290-49c8-8d4e-89059bbb3894 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:40.282064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:40.282064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:40.282064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:40.282064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:40.287667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:40.290524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:40.292631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:40.308009 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1269/2577] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:40.469187 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:40.471023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:40.545906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:40.550101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794e448-abe4-4c84-b585-af2a7a398027 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:40.554572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:40.554572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:40.554836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:40.555113 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:40.556973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:40.630893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:40.631903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ce003-64e2-4f21-bc5a-6fd549d11e8a service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:40.642506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1309/2578] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:41.516484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:41.528966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5371b1-43f9-4763-8cfb-a89dfa1892c1 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:41.535181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:41.536081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:41.536366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:41.536833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] PATH_INFO: `/v3/users/65b01aace46044808953aef639a2c731` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:41.539189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b01aace46044808953aef639a2c731)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:41.541077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:41.764795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b01aace46044808953aef639a2c731'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:41.765856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b01aace46044808953aef639a2c731'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:41.766799 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b01aace46044808953aef639a2c731'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:41.779091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b01aace46044808953aef639a2c731'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:41.861080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-44f9d0c2-095b-4362-a451-6ecad0996a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b01aace46044808953aef639a2c731'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:41.911871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1270/2579] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:41 2022] DELETE /identity/v3/users/65b01aace46044808953aef639a2c731 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:41.912655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:41.912655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:41.913170 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:41.914906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:41.915282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:41.915716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:41.935869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:41.936377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:41.937115 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:41.937554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:42.020156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1310/2580] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:42.027791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1271/2581] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:42.034723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:42.036570 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:42.051190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:42.052640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:42.136691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571bac-cd18-46a8-b983-2a52848a93f2 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:42.141274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:42.142021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:42.142313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:42.142609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:42.143040 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da1eb-3ce2-445e-bf36-d75f3a4fd452 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:42.148658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:42.149421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:42.149827 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:42.150258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:42.153508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:42.155251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:42.160151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:42.161955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:42.166939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1311/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:31:42.171831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1272/2583] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 09:31:43.150489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:43.156299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:43.177418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2612b-30fc-448f-830c-732ea72eef7c service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:43.196508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:43.198629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:43.199069 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:43.199341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] PATH_INFO: `/v3/projects/ae5a5e5fbc344b6c9a026763b315d83f` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:43.200979 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5a5e5fbc344b6c9a026763b315d83f)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:43.204552 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:43.418012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:43.437159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5a5e5fbc344b6c9a026763b315d83f', 'request_id': 'req-20901a96-8b57-4890-9634-84ef49ad1da8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.453290 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5a5e5fbc344b6c9a026763b315d83f', 'request_id': 'req-20901a96-8b57-4890-9634-84ef49ad1da8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.541467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5a5e5fbc344b6c9a026763b315d83f', 'request_id': 'req-20901a96-8b57-4890-9634-84ef49ad1da8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.572067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] The token cache is being invalidate because project ae5a5e5fbc344b6c9a026763b315d83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:43.572343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.573184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.574828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1312/2584] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:43 2022] DELETE /identity/v3/projects/ae5a5e5fbc344b6c9a026763b315d83f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:43.578985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:43.594950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:43.599462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a116-1e57-4fe4-bc31-46d10f8ba120 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:43.675909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:43.676859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:43.677147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:43.677429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] PATH_INFO: `/v3/users/2d6f29d780424887ae3dc47b0be069c6` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:43.678821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6f29d780424887ae3dc47b0be069c6)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:43.680755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:43.867922 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6f29d780424887ae3dc47b0be069c6'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.868960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6f29d780424887ae3dc47b0be069c6'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.869926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6f29d780424887ae3dc47b0be069c6'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:43.920955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6f29d780424887ae3dc47b0be069c6'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:44.028975 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-5e69f197-fdb1-4970-beb3-148224b23bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6f29d780424887ae3dc47b0be069c6'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:44.076772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1273/2585] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:43 2022] DELETE /identity/v3/users/2d6f29d780424887ae3dc47b0be069c6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:45.114406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:45.116039 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:45.171476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20901a96-8b57-4890-9634-84ef49ad1da8 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:45.270392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:45.271249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:45.271538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:45.271813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] PATH_INFO: `/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:45.273488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f64e9cadecd44b68434c0f53abe8a8d)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:45.276569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:45.433578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f64e9cadecd44b68434c0f53abe8a8d', 'request_id': 'req-6f642cef-7e72-402d-b8a9-2343a0e3f30e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:45.445909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f64e9cadecd44b68434c0f53abe8a8d', 'request_id': 'req-6f642cef-7e72-402d-b8a9-2343a0e3f30e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:45.520266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f64e9cadecd44b68434c0f53abe8a8d', 'request_id': 'req-6f642cef-7e72-402d-b8a9-2343a0e3f30e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:45.537349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] The token cache is being invalidate because project 9f64e9cadecd44b68434c0f53abe8a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:45.537794 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:45.538538 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-6f642cef-7e72-402d-b8a9-2343a0e3f30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:45.540953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1313/2586] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:45 2022] DELETE /identity/v3/projects/9f64e9cadecd44b68434c0f53abe8a8d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:45.546931 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:45.547445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:45.547614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:45.569252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:45.570699 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:45.656702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1274/2587] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:31:45.673854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:45.674269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:45.674622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:45.704642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:45.707269 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:45.716966 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1314/2588] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:45.721350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:45.742580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3c9d7-c75d-48a1-8bad-5641e517b72a None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:45.758016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:45.759067 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:45.760216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:45.761313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:45.763310 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:45.765036 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:45.766780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:45.805487 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:45.818363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1275/2589] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:45.820903 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cbfa1-cd7f-4c56-8de7-0347baeede29 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:45.835632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:45.836637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:45.837147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:45.837630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:45.839123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:45.841219 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:45.940875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1315/2590] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:45 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:45.945369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:45.957740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb571e6-204f-441e-986a-a704e041ad2f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:45.967330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:46.067855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:46.071137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.071917 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.072223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.074188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:46.077263 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:46.158947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1276/2591] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:45 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:46.163344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:46.189819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0980-c135-4a51-8761-2c3b8ec89628 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:46.201077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:46.202443 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.202907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.203600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.204720 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:46.206639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:46.223042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1316/2592] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:46.226906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:46.251985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f1d2e-1e36-4945-8f15-8241614cdc69 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:46.258376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:46.259741 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.260404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.260892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.262068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:46.264441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25835b2e-3a9c-4210-9a5e-745b5be2ab0f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:46.283284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:46.296142 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1277/2593] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:46.299033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ac59-e92c-4cdc-b660-db9d5aca6af6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:46.309654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:46.309654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.309654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.309654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] PATH_INFO: `/v3/projects/2ab9887672704f6cb5b5a7949dccfe6e/users/4b8a5920eb0a40d6beb7f5408e48184a/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.322939 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:46.328669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab9887672704f6cb5b5a7949dccfe6e, user_id=4b8a5920eb0a40d6beb7f5408e48184a, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:46.333467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:46.419821 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1317/2594] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:46 2022] PUT /identity/v3/projects/2ab9887672704f6cb5b5a7949dccfe6e/users/4b8a5920eb0a40d6beb7f5408e48184a/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:46.492320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.492544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.492800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.527921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] MFA Rules not processed for user `4b8a5920eb0a40d6beb7f5408e48184a`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:46.529283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:46.609695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1278/2595] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:46.615436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:46.737320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96548e0-eccd-4cc4-ab1b-32c18d752c98 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:46.755190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:46.755190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:46.755190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:46.755190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:46.755701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:46.755701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.130994 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1318/2596] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:46 2022] POST /identity/v3/projects => generated 373 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:47.135380 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:47.147833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2870e9-f3bf-478d-ade7-2d3f4a28f8e8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:47.252219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:47.253421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.253421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.253849 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.255658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:47.258211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.377007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1279/2597] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:47 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:47.377483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:47.395715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc113-0e9d-4ce4-80ac-563cf25f5098 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:47.402523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:47.410053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.410410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.410709 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.411496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:47.418743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.442651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1319/2598] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:47.445803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:47.468330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac935-882c-437c-b6fc-abd0fe356b28 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:47.478495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:47.479561 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.479850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.480130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] PATH_INFO: `/v3/projects/075697bf79e04af9ac18d90f4c3ab721/users/d4a667638d5d4c38987be3ea1181f5e0/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.498136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:47.510958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075697bf79e04af9ac18d90f4c3ab721, user_id=d4a667638d5d4c38987be3ea1181f5e0, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:47.515582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.620644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1280/2599] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:47 2022] PUT /identity/v3/projects/075697bf79e04af9ac18d90f4c3ab721/users/d4a667638d5d4c38987be3ea1181f5e0/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:47.624859 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:47.638783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3cb7-e21a-4eca-a49e-107868f115f7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:47.771670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:47.772384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.772924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.778079 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.779087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:47.781095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217def53-b386-4ed3-84fe-068c6c3d3862 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.807883 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1320/2600] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:47.809202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:47.824529 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee9b5-bc8f-4f52-b821-7782b24f1476 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:47.826088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:47.827239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.827753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.828257 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] PATH_INFO: `/v3/projects/075697bf79e04af9ac18d90f4c3ab721/users/d4a667638d5d4c38987be3ea1181f5e0/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.830775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075697bf79e04af9ac18d90f4c3ab721, user_id=d4a667638d5d4c38987be3ea1181f5e0, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:47.834296 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:47.864976 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1281/2601] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:47 2022] PUT /identity/v3/projects/075697bf79e04af9ac18d90f4c3ab721/users/d4a667638d5d4c38987be3ea1181f5e0/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:47.876633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:47.876980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:47.877185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:47.942731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] MFA Rules not processed for user `d4a667638d5d4c38987be3ea1181f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:47.946244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:48.060987 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:48.093166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1321/2602] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:48.108564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:48.111501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:48.220469 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bc285-5aa7-441f-9217-32ad96613317 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:48.227103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:48.228361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:48.229776 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:48.230960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:48.320082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:48.322382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:48.341614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1282/2603] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:51.188795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:51.192344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:51.329124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444ebb9-8099-4795-83ed-206c7d091391 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:51.334740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:51.335704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:51.335997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:51.336277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] PATH_INFO: `/v3/users/f1cf8604ac6c42e9bd2ab391c41ec573` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:51.337914 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cf8604ac6c42e9bd2ab391c41ec573)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:51.340176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:51.654589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:51.670572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8116-6f9e-4597-bdc6-ff5ffcdfdb04 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:51.680942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:51.680942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:51.680942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:51.680942 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] PATH_INFO: `/v3/users/4b8a5920eb0a40d6beb7f5408e48184a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:51.681443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8a5920eb0a40d6beb7f5408e48184a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:51.681443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:51.746388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cf8604ac6c42e9bd2ab391c41ec573'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:51.763986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cf8604ac6c42e9bd2ab391c41ec573'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:51.763986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cf8604ac6c42e9bd2ab391c41ec573'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:51.765933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cf8604ac6c42e9bd2ab391c41ec573'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:51.775054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-c2eb4fde-97a2-4ea7-9baf-3882ae9631db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cf8604ac6c42e9bd2ab391c41ec573'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.259801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1322/2604] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:51 2022] DELETE /identity/v3/users/f1cf8604ac6c42e9bd2ab391c41ec573 => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:52.331977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8a5920eb0a40d6beb7f5408e48184a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.332764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8a5920eb0a40d6beb7f5408e48184a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.345700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8a5920eb0a40d6beb7f5408e48184a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.357069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8a5920eb0a40d6beb7f5408e48184a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.438838 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8a5920eb0a40d6beb7f5408e48184a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.463487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:52.480645 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1283/2605] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:51 2022] DELETE /identity/v3/users/4b8a5920eb0a40d6beb7f5408e48184a => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:52.485030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:52.485327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:52.485648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:52.509419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:52.517877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:52.583872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:52.587550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:52.696629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1323/2606] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:52.706239 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:52.709057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:52.719263 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:52.738275 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae515-cca2-4e53-b4c0-cfcf205f50aa admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:52.750206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:52.751106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:52.751396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:52.751701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] PATH_INFO: `/v3/projects/905eab8cb4c54959b893ded1e647ef5f` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:52.752911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=905eab8cb4c54959b893ded1e647ef5f)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:52.756718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:52.771349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e580a9f-8bb5-4317-8997-d7775d8aff69 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:52.776397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:52.777253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:52.777685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:52.778092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:52.789293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:52.790921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:52.802886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1324/2607] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:52.912856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905eab8cb4c54959b893ded1e647ef5f', 'request_id': 'req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.991167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905eab8cb4c54959b893ded1e647ef5f', 'request_id': 'req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:52.997629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905eab8cb4c54959b893ded1e647ef5f', 'request_id': 'req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.011788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] The token cache is being invalidate because project 905eab8cb4c54959b893ded1e647ef5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:53.012220 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.013208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.020941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1284/2608] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:52 2022] DELETE /identity/v3/projects/905eab8cb4c54959b893ded1e647ef5f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:53.024320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:53.034630 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8987-a2aa-46f4-b895-193dec102db5 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:53.096567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:53.097446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:53.098129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:53.098129 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] PATH_INFO: `/v3/users/81d5d4501f6444f49737a38083445a61` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:53.099211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d5d4501f6444f49737a38083445a61)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:53.101119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:53.213026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:53.215045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:53.228426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe47ae-8526-4f3b-ad4e-5dbb71bca22f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:53.234568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:53.235559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:53.235845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:53.236207 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] PATH_INFO: `/v3/projects/2ab9887672704f6cb5b5a7949dccfe6e` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:53.237323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab9887672704f6cb5b5a7949dccfe6e)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:53.239344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:53.258991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d5d4501f6444f49737a38083445a61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.272843 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d5d4501f6444f49737a38083445a61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.273491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d5d4501f6444f49737a38083445a61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.274145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d5d4501f6444f49737a38083445a61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.281335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d5d4501f6444f49737a38083445a61'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.330714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab9887672704f6cb5b5a7949dccfe6e', 'request_id': 'req-784f4cfa-32bd-4b41-949d-f0646a6289a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.346616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1325/2609] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:53 2022] DELETE /identity/v3/users/81d5d4501f6444f49737a38083445a61 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:53.419792 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab9887672704f6cb5b5a7949dccfe6e', 'request_id': 'req-784f4cfa-32bd-4b41-949d-f0646a6289a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.426259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab9887672704f6cb5b5a7949dccfe6e', 'request_id': 'req-784f4cfa-32bd-4b41-949d-f0646a6289a8'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.437910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] The token cache is being invalidate because project 2ab9887672704f6cb5b5a7949dccfe6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:53.438211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.438898 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.440515 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1285/2610] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:53 2022] DELETE /identity/v3/projects/2ab9887672704f6cb5b5a7949dccfe6e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:53.444722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:53.446169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:53.481743 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:53.515457 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac485426-5b74-4a4b-94ba-37bf18edd749 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:53.520173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:53.521048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:53.521334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:53.521646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] PATH_INFO: `/v3/users/d4a667638d5d4c38987be3ea1181f5e0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:53.527108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a667638d5d4c38987be3ea1181f5e0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:53.527108 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:53.605605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:53.607077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:53.617868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:53.674306 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f4cfa-32bd-4b41-949d-f0646a6289a8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:53.679259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:53.680121 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:53.680406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:53.680683 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] PATH_INFO: `/v3/projects/88db6f1d0ab74c9696f85854d58a076f` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:53.682537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88db6f1d0ab74c9696f85854d58a076f)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:53.686069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:53.759075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a667638d5d4c38987be3ea1181f5e0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.773846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a667638d5d4c38987be3ea1181f5e0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.774555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a667638d5d4c38987be3ea1181f5e0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.775168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a667638d5d4c38987be3ea1181f5e0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.783190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a667638d5d4c38987be3ea1181f5e0'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.801732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88db6f1d0ab74c9696f85854d58a076f', 'request_id': 'req-d736beb7-ee97-48a4-87db-4358575e054d'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.855746 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1326/2611] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:31:53 2022] DELETE /identity/v3/users/d4a667638d5d4c38987be3ea1181f5e0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:31:53.940988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88db6f1d0ab74c9696f85854d58a076f', 'request_id': 'req-d736beb7-ee97-48a4-87db-4358575e054d'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.947847 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88db6f1d0ab74c9696f85854d58a076f', 'request_id': 'req-d736beb7-ee97-48a4-87db-4358575e054d'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.960569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] The token cache is being invalidate because project 88db6f1d0ab74c9696f85854d58a076f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:53.960862 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.961507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d736beb7-ee97-48a4-87db-4358575e054d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:53.964264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1286/2612] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:53 2022] DELETE /identity/v3/projects/88db6f1d0ab74c9696f85854d58a076f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:54.296507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:54.298027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:54.372011 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbee823-1f05-4084-8549-f470daed9d2f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:54.376942 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:54.377936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.378235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.378516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] PATH_INFO: `/v3/projects/075697bf79e04af9ac18d90f4c3ab721` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.379830 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=075697bf79e04af9ac18d90f4c3ab721)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:54.381770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:54.490034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075697bf79e04af9ac18d90f4c3ab721', 'request_id': 'req-f897fa96-e861-4106-aa1e-df91ac0c5dee'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:54.491207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:54.496555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075697bf79e04af9ac18d90f4c3ab721', 'request_id': 'req-f897fa96-e861-4106-aa1e-df91ac0c5dee'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:54.591984 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075697bf79e04af9ac18d90f4c3ab721', 'request_id': 'req-f897fa96-e861-4106-aa1e-df91ac0c5dee'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:54.604307 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] The token cache is being invalidate because project 075697bf79e04af9ac18d90f4c3ab721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:31:54.604594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:54.605236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f897fa96-e861-4106-aa1e-df91ac0c5dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:31:54.606791 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1327/2613] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:31:54 2022] DELETE /identity/v3/projects/075697bf79e04af9ac18d90f4c3ab721 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:54.611694 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.611990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.612274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.631508 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:54.632810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:54.692451 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1287/2614] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:54.700241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.701698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.701698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.718727 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:54.719967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:54.728046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1328/2615] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:54.732822 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:54.742512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe060cf-4fc5-42d7-bfac-9bfdd8cbd3ad None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:54.748015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:54.748672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.748958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.749239 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.749997 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:31:54.750307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:54.751905 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:54.763704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1288/2616] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:31:54.767996 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:54.778174 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e47ba-72c1-4c07-83b7-4534478eb68a None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:54.783049 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:54.783701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.784017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.784298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.784998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:54.786976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:54.862591 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1329/2617] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:31:54 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:31:54.866614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:54.876967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648c845-d7e7-40e9-a06e-08ff424878fc admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:54.902269 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:31:54.935528 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:54.936250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:54.936533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:54.936808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:54.937490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:54.942002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:55.016345 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1289/2618] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:31:54 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:31:55.020336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:55.032282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40054-506e-4b54-a9e6-998641496c34 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:55.038313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:55.039018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:55.039309 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:55.039587 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:55.040349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:55.042691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:55.055100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1330/2619] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:31:55.059043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:55.076522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52599bc-5914-46d1-96e7-14bbb8631c92 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:55.077225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:55.077924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:55.078211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:55.078489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:55.079256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:55.080865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce31c1-d37c-4550-b8cd-b95fa62d86f3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:55.091923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1290/2620] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:31:55.096680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:55.107421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99395fbe-d6e5-4542-b5ce-d034fe4ce34c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:55.112504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:55.113577 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:55.113951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:55.114237 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] PATH_INFO: `/v3/projects/736a9191294b42c491ab276420951e9e/users/4a1ecf2c90354128b3c4f7a57aced9a4/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:55.130117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] RBAC: Authorizing `identity:create_grant(project_id=736a9191294b42c491ab276420951e9e, user_id=4a1ecf2c90354128b3c4f7a57aced9a4, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:55.132998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:55.221249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1331/2621] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:31:55 2022] PUT /identity/v3/projects/736a9191294b42c491ab276420951e9e/users/4a1ecf2c90354128b3c4f7a57aced9a4/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:31:55.226497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765b66-cfa5-44f1-b41b-3f35efd0fe73 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:55.226791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765b66-cfa5-44f1-b41b-3f35efd0fe73 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:55.227073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765b66-cfa5-44f1-b41b-3f35efd0fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:55.247717 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-d0765b66-cfa5-44f1-b41b-3f35efd0fe73 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:55.248918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d0765b66-cfa5-44f1-b41b-3f35efd0fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:55.307712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1291/2622] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:55.317032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:55.318904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:55.375080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed997-7ad0-4305-b15d-e14affe2309a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:55.378754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:55.379402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:55.379693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:55.379977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:55.389176 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:55.390678 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:55.400358 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1332/2623] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:56.640153 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d8b9-3f28-48ca-94d0-0937be97b313 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:56.640758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d8b9-3f28-48ca-94d0-0937be97b313 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:56.640758 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d8b9-3f28-48ca-94d0-0937be97b313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:56.669438 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-acc0d8b9-3f28-48ca-94d0-0937be97b313 None None] MFA Rules not processed for user `4a1ecf2c90354128b3c4f7a57aced9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:56.670697 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-acc0d8b9-3f28-48ca-94d0-0937be97b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:56.736842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1292/2624] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:31:56.748278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:31:56.749740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:56.806500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6664e26-5d2d-4b49-b262-d9b7079b7898 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:31:56.810913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:31:56.811554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:56.816600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:56.816600 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:56.820568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:31:56.822097 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ecea2-c8c0-4126-9c45-fd4466f5b249 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:31:56.830869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1333/2625] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:31:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:31:58.529314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:31:58.529894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:31:58.529894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:31:58.548656 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] MFA Rules not processed for user `4a1ecf2c90354128b3c4f7a57aced9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:31:58.550021 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:31:58.557300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1293/2626] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:31:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:04.880628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:04.881077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:04.881185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:04.899589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:04.901496 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:04.917018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:04.969417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1334/2627] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:32:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:04.978192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:04.980364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:05.021914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:05.063042 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da14c8-0ed2-4da8-a276-c5510638338c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:05.068101 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:05.068993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:05.069277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:05.069554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:05.078462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:05.080052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:05.088789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1294/2628] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:32:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:32:06.836835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:06.838975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:06.851002 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15f1b-6e56-4302-afeb-3d346b6630e3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:06.855340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:06.856018 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:06.856308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:06.856589 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:06.858453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:06.872009 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:06.873464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:06.883940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1335/2629] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:32:10.513187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:10.514778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:10.534051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caaadb-1d80-4173-9191-b6a40707fe81 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:10.538600 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:10.539486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:10.544788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:10.544788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] PATH_INFO: `/v3/users/dd736a7cc9ef4e8787af2edc928dee0a` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:10.544788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd736a7cc9ef4e8787af2edc928dee0a)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:10.544788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:10.748691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd736a7cc9ef4e8787af2edc928dee0a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:10.749253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd736a7cc9ef4e8787af2edc928dee0a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:10.749888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd736a7cc9ef4e8787af2edc928dee0a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:10.756864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd736a7cc9ef4e8787af2edc928dee0a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:10.797234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-bd65cfd3-81fe-43f1-9955-39b14c5c649e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd736a7cc9ef4e8787af2edc928dee0a'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:10.815191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1295/2630] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:32:10 2022] DELETE /identity/v3/users/dd736a7cc9ef4e8787af2edc928dee0a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:11.062649 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.073316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a493c3-dc9c-4d06-927e-b42315f0134c service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.130194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.131054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.131337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.131614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] PATH_INFO: `/v3/projects/69345cc29014462ba2ba4f1440d3bb00` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.132790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=69345cc29014462ba2ba4f1440d3bb00)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.134710 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.248752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69345cc29014462ba2ba4f1440d3bb00', 'request_id': 'req-d834a19e-b36f-4544-8c72-3c8bcb85fdac'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:11.254241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69345cc29014462ba2ba4f1440d3bb00', 'request_id': 'req-d834a19e-b36f-4544-8c72-3c8bcb85fdac'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:11.345330 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69345cc29014462ba2ba4f1440d3bb00', 'request_id': 'req-d834a19e-b36f-4544-8c72-3c8bcb85fdac'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:11.358975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] The token cache is being invalidate because project 69345cc29014462ba2ba4f1440d3bb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:32:11.359273 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:11.359954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-d834a19e-b36f-4544-8c72-3c8bcb85fdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:11.361754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1336/2631] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:32:11 2022] DELETE /identity/v3/projects/69345cc29014462ba2ba4f1440d3bb00 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:11.366938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.367300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.367646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.386294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:11.387624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:11.448503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1296/2632] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:11.456396 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.456797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.457078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.475702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:11.476925 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:11.486301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1337/2633] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:11.490654 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.500715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c29b-17e0-493d-8752-97409dd904e8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.505320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.506012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.506298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.506577 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.507332 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:32:11.507640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.509233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.520986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1297/2634] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:32:11.525783 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.536348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f240d3b-9ad9-4e32-9985-933b94d841b9 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.541268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.545494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.545494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.545494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.545494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.546124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.640026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1338/2635] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:11 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:32:11.644217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.655888 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4459-8423-4e45-8f48-9140d08d6cce admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.668110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:11.712300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.712972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.713262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.713590 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.714918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.716861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.780004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1298/2636] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:11 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:11.783988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.795556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fcb4a-a291-45b3-b6ee-a72d4c9a8899 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.800355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.801054 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.801341 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.801656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.802595 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.804297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.816031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1339/2637] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:11.820126 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.830634 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a6f7-2f24-4926-bba1-79db280abeb7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.835283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.835959 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.836234 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.836510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.837247 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.838879 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f628de-394c-4340-b771-4cb8aa8db337 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.852477 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1299/2638] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:11.856038 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:11.861268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:11.866608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02882744-a8cf-4576-9348-e03ab7849760 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:11.871877 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:11.872762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.873047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.873327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] PATH_INFO: `/v3/projects/4fba8a11cc254394a45fd43ecd3ae9f0/users/95f4de9028b345df8d1d4f900649ee44/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.887467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fba8a11cc254394a45fd43ecd3ae9f0, user_id=95f4de9028b345df8d1d4f900649ee44, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:11.890202 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:11.957114 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1340/2639] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:11 2022] PUT /identity/v3/projects/4fba8a11cc254394a45fd43ecd3ae9f0/users/95f4de9028b345df8d1d4f900649ee44/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:32:11.968588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:11.968877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:11.969157 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:11.995729 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] MFA Rules not processed for user `95f4de9028b345df8d1d4f900649ee44`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:11.996928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:12.066028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1300/2640] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:12.070972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.134412 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38d75-bc58-4ecc-bd33-a4789b9f6458 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.139331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.139999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.140343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.140575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.141537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.143511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.218044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1341/2641] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:12 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:12.222052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.234424 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9002f-88d1-497c-aa17-925c6e2552bd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.295447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.296133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.296409 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.296681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.298484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.299357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.381091 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1301/2642] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:12 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:12.385266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.396850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f3e3-502b-4449-9b21-e5ca76e30228 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.402526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.403195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.403488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.403790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.404561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.406246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.417975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1342/2643] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:12.422070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.433165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c068d3-1033-4155-87c6-5b88a22345e4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.438211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.447760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.447760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.447760 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] PATH_INFO: `/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0/users/d2c32041087844fd97ce5da164790343/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.452606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:12.455755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc0021f2d9b4cce8f4c19728182fdc0, user_id=d2c32041087844fd97ce5da164790343, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.458560 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.558278 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1302/2644] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:12 2022] PUT /identity/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0/users/d2c32041087844fd97ce5da164790343/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:12.562471 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.572664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb052aa0-a6da-43c7-90b4-9b9bda34e43b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.638731 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.639516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.639875 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.640228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.641100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.642827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93280b79-db52-4f66-ae2a-ca231e0b3a2d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.661959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1343/2645] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 09:32:12.662150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.669159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172446c-393a-456c-b425-9b21e018b332 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.673980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.674874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.675291 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.675574 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] PATH_INFO: `/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0/users/d2c32041087844fd97ce5da164790343/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.677901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc0021f2d9b4cce8f4c19728182fdc0, user_id=d2c32041087844fd97ce5da164790343, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.680728 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.692808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1303/2646] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:12 2022] PUT /identity/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0/users/d2c32041087844fd97ce5da164790343/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:12.715134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.715134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.715134 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.738543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] MFA Rules not processed for user `d2c32041087844fd97ce5da164790343`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:12.739764 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:12.777948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:12.806965 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1344/2647] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:32:12.818720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:12.820407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:12.877934 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f18d-e0f8-40aa-9877-6488fe4aa775 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:12.881751 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:12.882423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:12.882714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:12.882993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:12.892727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:12.894218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:12.903944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1304/2648] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:32:13.021816 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:13.023473 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:13.035692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70243da3-f722-4498-af2c-7e676ac2948b None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:13.039338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:13.040013 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:13.041026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:13.041026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:13.097633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:13.099124 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8514a2-5390-44eb-8783-209001eb0093 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:13.108534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1345/2649] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:17.972775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:18.037378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0d255-e739-497d-ad99-061d57d89c99 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:18.041977 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:18.043518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:18.043805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:18.044082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] PATH_INFO: `/v3/users/95f4de9028b345df8d1d4f900649ee44` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:18.045397 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f4de9028b345df8d1d4f900649ee44)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:18.047431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:18.204597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f4de9028b345df8d1d4f900649ee44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:18.205243 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f4de9028b345df8d1d4f900649ee44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:18.205868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f4de9028b345df8d1d4f900649ee44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:18.212805 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f4de9028b345df8d1d4f900649ee44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:18.295351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f4de9028b345df8d1d4f900649ee44'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:18.310883 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:18.315189 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1305/2650] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:32:17 2022] DELETE /identity/v3/users/95f4de9028b345df8d1d4f900649ee44 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:18.319674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:18.320122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:18.320274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:18.337991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:18.339719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:18.399602 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1346/2651] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:18.409911 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:18.414472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:18.485443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaea2fd-056c-4010-b226-97d3ac6e8aed admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:18.490014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:18.490607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:18.490894 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:18.491191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:18.504594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:18.505401 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:18.516338 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1306/2652] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:18.936740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:18.938198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:18.955628 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cbb8f-021d-4fee-a525-ad537610a890 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:18.960504 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:18.961387 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:18.961730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:18.962014 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] PATH_INFO: `/v3/projects/4fba8a11cc254394a45fd43ecd3ae9f0` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:18.963242 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fba8a11cc254394a45fd43ecd3ae9f0)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:18.965287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:19.096293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fba8a11cc254394a45fd43ecd3ae9f0', 'request_id': 'req-0ceb4573-b035-4013-a2ee-afd5230db1f1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.102943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fba8a11cc254394a45fd43ecd3ae9f0', 'request_id': 'req-0ceb4573-b035-4013-a2ee-afd5230db1f1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.175032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fba8a11cc254394a45fd43ecd3ae9f0', 'request_id': 'req-0ceb4573-b035-4013-a2ee-afd5230db1f1'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.177338 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:19.187558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] The token cache is being invalidate because project 4fba8a11cc254394a45fd43ecd3ae9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:32:19.187766 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.188454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-0ceb4573-b035-4013-a2ee-afd5230db1f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.190066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1347/2653] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:32:18 2022] DELETE /identity/v3/projects/4fba8a11cc254394a45fd43ecd3ae9f0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:32:19.194138 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:19.204128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feddaf3-9a07-4582-91a3-365582fcf3e5 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:19.261045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:19.262043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:19.262324 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:19.262605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] PATH_INFO: `/v3/users/d2c32041087844fd97ce5da164790343` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:19.263887 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c32041087844fd97ce5da164790343)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:19.265914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:19.485462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c32041087844fd97ce5da164790343'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.486062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c32041087844fd97ce5da164790343'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.486653 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c32041087844fd97ce5da164790343'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.493726 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c32041087844fd97ce5da164790343'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.558730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c32041087844fd97ce5da164790343'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:19.578446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1307/2654] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:32:19 2022] DELETE /identity/v3/users/d2c32041087844fd97ce5da164790343 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:19.781395 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc71cf-8a6e-4528-a2ed-bc4d423b2802 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:19.782324 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc71cf-8a6e-4528-a2ed-bc4d423b2802 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:19.782758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc71cf-8a6e-4528-a2ed-bc4d423b2802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:19.803469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-69dc71cf-8a6e-4528-a2ed-bc4d423b2802 None None] MFA Rules not processed for user `4a1ecf2c90354128b3c4f7a57aced9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:19.804946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-69dc71cf-8a6e-4528-a2ed-bc4d423b2802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:19.864769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1348/2655] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:20.000210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.001665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:20.043242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:20.083311 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a96616-9fea-440a-bb37-5afb5573e3ad admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.087980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.089445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.089767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.090298 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] PATH_INFO: `/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.091778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc0021f2d9b4cce8f4c19728182fdc0)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.093752 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.199893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc0021f2d9b4cce8f4c19728182fdc0', 'request_id': 'req-270339a0-2375-4835-bad8-fa1e5b1ccfc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:20.266499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc0021f2d9b4cce8f4c19728182fdc0', 'request_id': 'req-270339a0-2375-4835-bad8-fa1e5b1ccfc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:20.273212 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc0021f2d9b4cce8f4c19728182fdc0', 'request_id': 'req-270339a0-2375-4835-bad8-fa1e5b1ccfc3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:20.285420 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] The token cache is being invalidate because project efc0021f2d9b4cce8f4c19728182fdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:32:20.287865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:20.287865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-270339a0-2375-4835-bad8-fa1e5b1ccfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:20.288568 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1308/2656] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:32:19 2022] DELETE /identity/v3/projects/efc0021f2d9b4cce8f4c19728182fdc0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:20.293374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.293696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.293975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.313096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:20.314357 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:20.375904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1349/2657] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:20.384594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.384891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.385171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.405450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:20.406723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:20.414678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1309/2658] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:20.419048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.429233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bf4cf-4ee1-49c5-aa21-00618f528386 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.434513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.436787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.436787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.436787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.436787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:32:20.436787 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.438415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.450839 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1350/2659] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:32:20.455124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.464713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8813e51-5d9c-4a0c-b1f5-fcfb1c4b94e7 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.469439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.470171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.470459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.470737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.471441 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.473375 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.580859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1310/2660] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:20 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:20.582514 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.592598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0aced-fa04-4eed-9ad0-faa618be809b admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.654063 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.654740 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.655026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.655304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.656065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.658060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.767865 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1351/2661] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:20 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:32:20.772476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.783168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced1d7-2efa-4a4c-9d20-46740cbc27aa admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.787957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.788630 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.788923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.789229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.790012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.791700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.803282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1311/2662] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:20.807346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.818264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291655d8-0105-44d6-a6bb-370b4c7d91a6 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.822758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.823705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.824017 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.824295 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.825019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.826646 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100de4cd-1f74-4cf4-b377-5a401d033eda admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.836301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1352/2663] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:20.840559 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:20.850964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b4db-417c-49bf-934d-018968158843 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:20.856468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:20.857390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.857708 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.857996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] PATH_INFO: `/v3/projects/f812e6234a4e4ec2a43db8800ea483c2/users/66ad9d37a73844efb983d16edba1177a/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.875071 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f812e6234a4e4ec2a43db8800ea483c2, user_id=66ad9d37a73844efb983d16edba1177a, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:20.877803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:20.951195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1312/2664] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:20 2022] PUT /identity/v3/projects/f812e6234a4e4ec2a43db8800ea483c2/users/66ad9d37a73844efb983d16edba1177a/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:20.961500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:20.961845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:20.962126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:20.976296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:20.991657 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] MFA Rules not processed for user `66ad9d37a73844efb983d16edba1177a`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:20.992892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:21.059346 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1353/2665] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:21.063852 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.113316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:21.126240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d4d3-da2a-40e0-9374-ccbb7dc84716 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.130974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.131635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.131933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.132209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.132897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.134831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.216950 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1313/2666] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:21 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:21.220918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.232340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a97009-1f67-40ad-bb08-e4b0d184ed6c None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.288096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.288701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.288988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.289265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.290004 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.292553 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.388074 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1354/2667] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:21 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:21.391982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.403248 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fa30b-a3d8-4661-9e3c-93efec527abd admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.408035 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.408691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.408980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.409264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.410022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.412539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.423489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1314/2668] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:21.428095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.438642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8b11f-babd-4aa6-88aa-fb035e926fa4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.443366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.444347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.444633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.444913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] PATH_INFO: `/v3/projects/81242b3a71e845c2a8c4174b3b96d793/users/0e976bb49d2f4f7a9fe0a1282b551fcc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.460511 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81242b3a71e845c2a8c4174b3b96d793, user_id=0e976bb49d2f4f7a9fe0a1282b551fcc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.463188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.569688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1355/2669] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:21 2022] PUT /identity/v3/projects/81242b3a71e845c2a8c4174b3b96d793/users/0e976bb49d2f4f7a9fe0a1282b551fcc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:21.574418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.584646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44956681-109f-4ca6-8cd0-8936e7130d3e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.646408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.647383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.647674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.647955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.648700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.650347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbdb8e-e20c-4ae8-a540-ccd719dc4ff0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.667484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1315/2670] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:21.668688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.679976 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c635fe-8f7d-4cc2-9d8f-4ce4d560ff5a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.685393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.686350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.686639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.686945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] PATH_INFO: `/v3/projects/81242b3a71e845c2a8c4174b3b96d793/users/0e976bb49d2f4f7a9fe0a1282b551fcc/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.688953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] RBAC: Authorizing `identity:create_grant(project_id=81242b3a71e845c2a8c4174b3b96d793, user_id=0e976bb49d2f4f7a9fe0a1282b551fcc, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.691658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.702728 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1356/2671] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:21 2022] PUT /identity/v3/projects/81242b3a71e845c2a8c4174b3b96d793/users/0e976bb49d2f4f7a9fe0a1282b551fcc/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:21.713133 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.713429 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.714526 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.740483 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] MFA Rules not processed for user `0e976bb49d2f4f7a9fe0a1282b551fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:21.741732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:21.813525 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1316/2672] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:21.824927 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:21.826643 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:21.880729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:21.884869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824eba1-e52d-422a-aa5f-1822f007ffda admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:21.888846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:21.893702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:21.893702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:21.893702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:21.945921 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:21.947350 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:21.957044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1357/2673] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:24.679702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:24.690517 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d188e2e-cb84-499e-bb1a-13e982c12e34 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:24.694877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:24.695623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:24.695909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:24.696250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:24.706333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:24.707787 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a66d17-56a5-4ecd-85e8-65388fe8c2c9 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:24.718657 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1317/2674] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:28.888147 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:28.952951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a3f-a7d0-4711-a7db-af1037ae3e85 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:28.957521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:28.958418 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:28.958708 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:28.959022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] PATH_INFO: `/v3/users/66ad9d37a73844efb983d16edba1177a` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:28.960228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ad9d37a73844efb983d16edba1177a)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:28.962194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:29.175539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ad9d37a73844efb983d16edba1177a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:29.187402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ad9d37a73844efb983d16edba1177a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:29.188080 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ad9d37a73844efb983d16edba1177a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:29.188696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ad9d37a73844efb983d16edba1177a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:29.195528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ad9d37a73844efb983d16edba1177a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:29.258491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1358/2675] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:32:28 2022] DELETE /identity/v3/users/66ad9d37a73844efb983d16edba1177a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:29.263859 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:29.267026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:29.267026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:29.282137 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:29.283377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:29.309183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:29.342503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1318/2676] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:29.352193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:29.353610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:29.380924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:29.413423 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a031-5f6b-4186-9ed7-6b7e88e632df admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:29.417268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:29.417959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:29.418235 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:29.418513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:29.427896 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:29.429264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:29.439892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1359/2677] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:29.992868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:29.994348 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:30.008696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a66094-e0eb-4f9b-8713-24921ca32e57 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:30.014122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:30.015197 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:30.015490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:30.015771 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] PATH_INFO: `/v3/projects/f812e6234a4e4ec2a43db8800ea483c2` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:30.017008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f812e6234a4e4ec2a43db8800ea483c2)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:30.019051 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:30.107570 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f812e6234a4e4ec2a43db8800ea483c2', 'request_id': 'req-3ef543c6-04de-484b-b04d-69ebffd3844c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.163576 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f812e6234a4e4ec2a43db8800ea483c2', 'request_id': 'req-3ef543c6-04de-484b-b04d-69ebffd3844c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.170901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f812e6234a4e4ec2a43db8800ea483c2', 'request_id': 'req-3ef543c6-04de-484b-b04d-69ebffd3844c'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.181755 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] The token cache is being invalidate because project f812e6234a4e4ec2a43db8800ea483c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:32:30.185262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.185262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.185262 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1319/2678] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:32:29 2022] DELETE /identity/v3/projects/f812e6234a4e4ec2a43db8800ea483c2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:30.188498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:30.198691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94e61-2f1d-434b-8588-45848d18aed4 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:30.256268 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:30.257056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:30.257348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:30.257667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] PATH_INFO: `/v3/users/0e976bb49d2f4f7a9fe0a1282b551fcc` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:30.258902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e976bb49d2f4f7a9fe0a1282b551fcc)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:30.261131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:30.440375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e976bb49d2f4f7a9fe0a1282b551fcc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.455123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e976bb49d2f4f7a9fe0a1282b551fcc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.455868 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e976bb49d2f4f7a9fe0a1282b551fcc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.456488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e976bb49d2f4f7a9fe0a1282b551fcc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.464214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-1f885056-4f7c-4d4d-b647-ede5ca98ad58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e976bb49d2f4f7a9fe0a1282b551fcc'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:30.530284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1360/2679] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:32:30 2022] DELETE /identity/v3/users/0e976bb49d2f4f7a9fe0a1282b551fcc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:30.931082 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:30.932807 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:30.946784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef543c6-04de-484b-b04d-69ebffd3844c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.008811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.009721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.010005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.010437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] PATH_INFO: `/v3/projects/81242b3a71e845c2a8c4174b3b96d793` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.011782 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81242b3a71e845c2a8c4174b3b96d793)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.014352 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.122624 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81242b3a71e845c2a8c4174b3b96d793', 'request_id': 'req-1034c409-59e0-440c-b830-1336866aea79'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:31.174495 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81242b3a71e845c2a8c4174b3b96d793', 'request_id': 'req-1034c409-59e0-440c-b830-1336866aea79'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:31.175798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:31.180736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81242b3a71e845c2a8c4174b3b96d793', 'request_id': 'req-1034c409-59e0-440c-b830-1336866aea79'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:31.191650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] The token cache is being invalidate because project 81242b3a71e845c2a8c4174b3b96d793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:32:31.191937 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:31.192571 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1034c409-59e0-440c-b830-1336866aea79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:32:31.194171 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1320/2680] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:32:30 2022] DELETE /identity/v3/projects/81242b3a71e845c2a8c4174b3b96d793 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:31.199528 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.200046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.200153 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.218682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:31.219964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:31.261294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:31.279815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1361/2681] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:31.288673 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.288967 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.289250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.309502 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:31.310855 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:31.318980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1321/2682] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:31.323417 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.332887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0e1dd-023a-41b3-9952-d32d14431aef None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.337478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.338173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.338503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.338811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.339621 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:32:31.339931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.341527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.352999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1362/2683] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:32:31.358286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.367558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260d70-083a-4ca3-9dbf-541b470fdc6b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.372991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.373713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.374004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.374287 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.374982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.376914 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.473088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1322/2684] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:31 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:31.477982 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.488561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75704e12-183c-4b86-86fa-6e2ddf2f6601 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.544950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.545742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.546026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.546302 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.546989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.548888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.643547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1363/2685] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:31 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:31.648809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.660102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da671d-82db-477e-8fa5-df8646202989 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.665092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.665817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.666140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.666381 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.668049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.669693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.680329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1323/2686] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:31.685251 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.695557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76055-7c4e-45b8-9337-6b9160d92347 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.701682 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.702441 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.702734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.703015 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.703749 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.705382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545727c3-b652-4022-99a6-71a5c2a2c743 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.716299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1364/2687] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:31.720696 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.731314 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e6b8e-d101-41a0-92ee-34deddfcac40 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.735955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.736932 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.737215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.737486 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] PATH_INFO: `/v3/projects/8ae8feb422b146dab980e6365336a4ab/users/aaa1b523f6594e80b407b133c04094f6/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.752208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae8feb422b146dab980e6365336a4ab, user_id=aaa1b523f6594e80b407b133c04094f6, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.754897 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.814022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1324/2688] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:31 2022] PUT /identity/v3/projects/8ae8feb422b146dab980e6365336a4ab/users/aaa1b523f6594e80b407b133c04094f6/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:31.819258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0276-f004-4747-9b59-b36aeae6e485 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.819555 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0276-f004-4747-9b59-b36aeae6e485 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.819841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0276-f004-4747-9b59-b36aeae6e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.837737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-341b0276-f004-4747-9b59-b36aeae6e485 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:31.839537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-341b0276-f004-4747-9b59-b36aeae6e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:31.899051 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1365/2689] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:31.909144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:31.910893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:31.968606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4381dd-803b-4bcd-a0d8-261015bc19f6 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:31.972407 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:31.973084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:31.973415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:31.973723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:31.983106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:31.984615 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:31.994145 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1325/2690] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:33.427948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:33.427948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:33.427948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:33.461298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] MFA Rules not processed for user `aaa1b523f6594e80b407b133c04094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:33.462561 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:33.506742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:33.533663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1366/2691] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:33.538252 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:33.548954 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa07cc5-eedc-4f4c-8ee0-d638880d2424 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:33.554663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:33.555376 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:33.555607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:33.555885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:33.556572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:33.558829 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:33.668772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1326/2692] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:32:33 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:33.673140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:33.683889 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306a044-3766-4e8e-8789-fa8f8fe3399e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:33.741244 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:33.741957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:33.742248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:33.742529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:33.743284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:33.745776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:33.839493 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1367/2693] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:32:33 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:32:33.843505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:33.858198 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c04d-9c82-46c4-8e9d-730a7e6d2252 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:33.861603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:33.862480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:33.862773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:33.863054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:33.863863 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:33.865688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:33.876698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1327/2694] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:33.880922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:33.896527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c04b2-4db9-45e1-b96b-09d979b16451 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:33.902152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:33.903078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:33.903365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:33.903650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] PATH_INFO: `/v3/projects/8dedd64815e949ed823f6caead792913/users/8511ba83a53441b984fd78f18099ec5e/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:33.919527 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dedd64815e949ed823f6caead792913, user_id=8511ba83a53441b984fd78f18099ec5e, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:33.922229 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:33.998096 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1368/2695] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:33 2022] PUT /identity/v3/projects/8dedd64815e949ed823f6caead792913/users/8511ba83a53441b984fd78f18099ec5e/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:34.002233 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:34.012603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b7c95-e203-4e7f-a8bd-e00919f33502 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:34.053642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:34.069781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:34.070450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:34.070732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:34.071010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:34.071738 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:34.073445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5bc41-abc1-4ea5-a47a-941885c6e198 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:34.083120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1328/2696] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:32:34.087336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:34.098509 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28b0e-0b59-4457-8858-3d8d4b49fd87 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:34.103279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:34.104894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:34.105182 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:34.105465 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] PATH_INFO: `/v3/projects/8dedd64815e949ed823f6caead792913/users/8511ba83a53441b984fd78f18099ec5e/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:34.107618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dedd64815e949ed823f6caead792913, user_id=8511ba83a53441b984fd78f18099ec5e, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:34.110306 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b873edc-98da-4af5-a374-42f7ded754de admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:34.120860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1369/2697] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:32:34 2022] PUT /identity/v3/projects/8dedd64815e949ed823f6caead792913/users/8511ba83a53441b984fd78f18099ec5e/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:32:35.330410 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:35.330918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:35.331004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:35.359365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] MFA Rules not processed for user `8511ba83a53441b984fd78f18099ec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:35.360658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:35.433152 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1329/2698] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:32:35.444639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f400-0e8e-490c-ac67-434a1dff2b5e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:35.445188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f400-0e8e-490c-ac67-434a1dff2b5e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:35.445188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f400-0e8e-490c-ac67-434a1dff2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:35.464958 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-5ab9f400-0e8e-490c-ac67-434a1dff2b5e None None] MFA Rules not processed for user `aaa1b523f6594e80b407b133c04094f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:35.466234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5ab9f400-0e8e-490c-ac67-434a1dff2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:35.521304 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1370/2699] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:35.533330 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:35.534784 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:35.610675 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d63e-4db7-476f-92db-285f2eeeb076 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:35.616242 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:35.616891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:35.617178 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:35.617460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:35.626309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:35.627900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:35.636871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1330/2700] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:41.816421 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:41.816837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:41.817043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:41.837789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:41.839072 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:41.872215 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:41.895948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1371/2701] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:41.920057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:41.921453 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:41.975333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=100 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:41.995555 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d177-0bb5-4b8e-b2ca-e43b7feea1c4 service nova] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:42.001218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:42.001900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:42.002188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:42.002470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:42.010501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:42.012691 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:42.020798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1331/2702] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 09:32:44.639363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:44.641031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:44.712356 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e79033-a969-43ba-9462-6fc3c58bcad7 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:44.716562 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:44.717320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:44.717739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:44.718100 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:44.720513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:44.734578 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:44.736020 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:44.747738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1372/2703] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:45.932706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:45.952215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f921b1-49f2-4f43-9cb1-ff790f43b450 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:45.955891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:45.956522 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:45.956837 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:45.957113 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:45.958982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:45.973927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:45.975350 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f7cd-ce63-4594-8527-3ccafbcc71da service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:45.989355 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1332/2704] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:52.091065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:52.093012 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:52.174337 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60e50f-cb15-4440-a3d2-7c09e74dad55 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:52.178028 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:52.178715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:52.178953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:52.179246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:52.189593 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:52.191087 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:52.204211 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1373/2705] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:32:55.982949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=16 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:32:58.428721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:58.429302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:58.429302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:58.477292 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:32:58.478537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:32:58.495872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1333/2706] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:32:58.509195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:32:58.531253 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26a24-d79c-410d-ba28-489d5ecaa2b8 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:32:58.536547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:32:58.537190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:32:58.537478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:32:58.537790 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:32:58.546392 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:32:58.547969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:32:58.556373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1374/2707] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:32:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:33:01.660094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:01.661542 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:01.728990 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c86500-e392-4cbe-a0ac-9423844a42b3 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:01.734556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:01.735426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:01.735711 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:01.735983 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] PATH_INFO: `/v3/users/4a1ecf2c90354128b3c4f7a57aced9a4` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:01.737211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1ecf2c90354128b3c4f7a57aced9a4)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:01.739159 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:01.939821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1ecf2c90354128b3c4f7a57aced9a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:01.939821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1ecf2c90354128b3c4f7a57aced9a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:01.939821 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1ecf2c90354128b3c4f7a57aced9a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:01.946012 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1ecf2c90354128b3c4f7a57aced9a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.014793 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b10eb1f3-ebdf-4391-9fef-742e7420efdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1ecf2c90354128b3c4f7a57aced9a4'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.033431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1334/2708] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:01 2022] DELETE /identity/v3/users/4a1ecf2c90354128b3c4f7a57aced9a4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:02.290228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:02.295310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8e34-abad-437d-94c9-25c233c8a624 service swift] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:02.367964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:02.368837 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:02.369123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:02.369397 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] PATH_INFO: `/v3/projects/736a9191294b42c491ab276420951e9e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:02.370640 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736a9191294b42c491ab276420951e9e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:02.373171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:02.381369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=100 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:02.528225 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736a9191294b42c491ab276420951e9e', 'request_id': 'req-b5a4e280-083d-4b9a-95dc-3499712a4654'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.533750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736a9191294b42c491ab276420951e9e', 'request_id': 'req-b5a4e280-083d-4b9a-95dc-3499712a4654'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.630236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736a9191294b42c491ab276420951e9e', 'request_id': 'req-b5a4e280-083d-4b9a-95dc-3499712a4654'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.642563 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] The token cache is being invalidate because project 736a9191294b42c491ab276420951e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:02.642854 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.643494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b5a4e280-083d-4b9a-95dc-3499712a4654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:02.645023 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1375/2709] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:02 2022] DELETE /identity/v3/projects/736a9191294b42c491ab276420951e9e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:02.650236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:02.650530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:02.650812 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:02.668316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:02.670165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:02.705110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:02.730123 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1335/2710] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:02.738227 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:02.742093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:02.742093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:02.757440 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:02.758763 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:02.767000 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1376/2711] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:02.771106 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:02.780912 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a6a9-ca3d-4090-aea3-aaaf9a7820f8 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:02.785504 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:02.786179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:02.786485 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:02.786759 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:02.787474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:33:02.787778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:02.789353 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:02.801374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1336/2712] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:33:02.805711 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:02.815970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ea12-2059-4682-84a0-598e0bdd1700 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:02.820732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:02.821380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:02.821702 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:02.821980 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:02.822672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:02.824639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:02.941667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1377/2713] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:33:02 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:02.945819 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:02.955788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb640b6a-2d1d-4790-b46d-53e0bd6a9480 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:03.011676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:03.012337 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.012617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.012891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.013860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:03.015742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:03.106366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1337/2714] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:33:02 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:03.111257 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:03.121801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdbb7a-2807-4998-a4ae-b436914e08ba admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:03.126683 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:03.127348 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.127750 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.128042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.128773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:03.130431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:03.141366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1378/2715] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:03.145304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:03.156139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18225d-254f-40c9-9ef3-132340bfc9ac admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:03.160764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:03.161421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.161749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.162039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.164192 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:03.164357 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc3d2a-0f10-4549-88aa-2da4355f2813 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:03.175442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1338/2716] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:03.179718 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:03.189963 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3f14-5fd3-4bd9-bb52-fe03c13523f3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:03.195030 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:03.195967 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.196255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.196535 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] PATH_INFO: `/v3/projects/54b1635141434dbb99913d13807b9e73/users/81a1193137304f93a5e982621399e830/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.211694 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b1635141434dbb99913d13807b9e73, user_id=81a1193137304f93a5e982621399e830, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:03.214415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:03.282670 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1379/2717] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:33:03 2022] PUT /identity/v3/projects/54b1635141434dbb99913d13807b9e73/users/81a1193137304f93a5e982621399e830/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:03.300506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.300506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.300506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.321948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] MFA Rules not processed for user `81a1193137304f93a5e982621399e830`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:03.323174 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:03.397739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1339/2718] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:03.406351 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:03.408277 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:03.468468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf92e-048e-4e16-85e7-b26b4e63a533 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:03.472221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:03.473035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:03.473388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:03.473704 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:03.482086 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:03.483558 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9a7d9-980c-4c49-8db4-1d68bb34f3ce service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:03.492605 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1380/2719] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:07.631980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:07.672893 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:07.695949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cea7b-603b-4c79-bb3a-3a4c71459355 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:07.700678 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:07.701583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:07.701884 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:07.702158 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] PATH_INFO: `/v3/users/81a1193137304f93a5e982621399e830` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:07.703501 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a1193137304f93a5e982621399e830)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:07.705456 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:07.942649 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a1193137304f93a5e982621399e830'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:07.943322 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a1193137304f93a5e982621399e830'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:07.943918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a1193137304f93a5e982621399e830'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:07.951007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a1193137304f93a5e982621399e830'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.031677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a1193137304f93a5e982621399e830'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.051334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1340/2720] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:07 2022] DELETE /identity/v3/users/81a1193137304f93a5e982621399e830 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:08.055873 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:08.056373 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:08.056488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:08.074688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:08.075992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:08.107426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:08.136299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1381/2721] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:08.146004 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:08.147773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:08.206083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bf9b6-86f2-4e53-974e-d71041c0cd72 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:08.209774 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:08.210426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:08.210712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:08.210989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:08.222140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:08.223116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acdea4-a088-42c0-b9c6-971a345f47d8 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:08.233677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1341/2722] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:08.654664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:08.656126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:08.669016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cebd5-ec42-485a-a705-9372b0a045fc None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:08.675019 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:08.676853 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:08.682175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:08.682175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] PATH_INFO: `/v3/projects/54b1635141434dbb99913d13807b9e73` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:08.682175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b1635141434dbb99913d13807b9e73)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:08.682175 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:08.803140 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b1635141434dbb99913d13807b9e73', 'request_id': 'req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.810055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b1635141434dbb99913d13807b9e73', 'request_id': 'req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.866204 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b1635141434dbb99913d13807b9e73', 'request_id': 'req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.878033 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] The token cache is being invalidate because project 54b1635141434dbb99913d13807b9e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:08.878323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.878973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:08.880688 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1382/2723] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:08 2022] DELETE /identity/v3/projects/54b1635141434dbb99913d13807b9e73 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:14.718385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:14.718874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:14.718982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:14.735612 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] MFA Rules not processed for user `e34d5f6de8f64902b3126e4d464d34a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:14.736803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:14.791103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1342/2724] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:33:15.140105 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:15.141631 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:15.198384 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37c7e-cfa1-450e-adfb-f1866ba3a1c8 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:15.202614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:15.203259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:15.203548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:15.203827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:15.205687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:15.215298 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:15.216736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:15.225494 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1383/2725] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:15.921342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:15.921342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:15.927019 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:16.010184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceae73-77e6-499e-8d56-6d6ef216c331 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:16.018161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:16.018161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:16.018161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:16.018161 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:16.018789 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:16.031214 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:16.032848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:16.043208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1343/2726] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:16.788166 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:16.789696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:16.855365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb6f82-0cff-4627-af4b-bd737cbe9bd2 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:16.860190 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:16.861057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:16.861343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:16.861660 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] PATH_INFO: `/v3/users/aaa1b523f6594e80b407b133c04094f6` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:16.862858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa1b523f6594e80b407b133c04094f6)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:16.864768 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:16.867042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:17.091270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa1b523f6594e80b407b133c04094f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.103404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa1b523f6594e80b407b133c04094f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.104112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa1b523f6594e80b407b133c04094f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.104729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa1b523f6594e80b407b133c04094f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.111876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa1b523f6594e80b407b133c04094f6'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.236824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1384/2727] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:16 2022] DELETE /identity/v3/users/aaa1b523f6594e80b407b133c04094f6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:17.530613 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:17.544580 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d39b-0fca-474f-9b31-05039cbc33dd service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:17.608602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:17.609490 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:17.609823 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:17.610103 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] PATH_INFO: `/v3/projects/8ae8feb422b146dab980e6365336a4ab` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:17.611383 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae8feb422b146dab980e6365336a4ab)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:17.613455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:17.807026 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae8feb422b146dab980e6365336a4ab', 'request_id': 'req-b55761fe-0e77-4134-88cd-bcc25c44b6cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.859853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae8feb422b146dab980e6365336a4ab', 'request_id': 'req-b55761fe-0e77-4134-88cd-bcc25c44b6cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.866014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae8feb422b146dab980e6365336a4ab', 'request_id': 'req-b55761fe-0e77-4134-88cd-bcc25c44b6cc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.877516 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] The token cache is being invalidate because project 8ae8feb422b146dab980e6365336a4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:17.877974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.878650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:17.880216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1344/2728] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:17 2022] DELETE /identity/v3/projects/8ae8feb422b146dab980e6365336a4ab => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:17.884436 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:17.886614 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:17.899784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2eea-1ebb-467d-8cc6-c877b54e51e2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:17.957478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:17.958388 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:17.958674 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:17.958954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] PATH_INFO: `/v3/users/8511ba83a53441b984fd78f18099ec5e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:17.960148 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8511ba83a53441b984fd78f18099ec5e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:17.962109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:18.153502 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8511ba83a53441b984fd78f18099ec5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.168216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8511ba83a53441b984fd78f18099ec5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.168992 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8511ba83a53441b984fd78f18099ec5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.169626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8511ba83a53441b984fd78f18099ec5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.177460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b83fc00d-5ca2-4446-bc32-2633cd6c10c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8511ba83a53441b984fd78f18099ec5e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.284888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:18.289475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1385/2729] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:17 2022] DELETE /identity/v3/users/8511ba83a53441b984fd78f18099ec5e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:33:18.545828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:18.547461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:18.571845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55761fe-0e77-4134-88cd-bcc25c44b6cc admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:18.591700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:18.631970 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:18.632982 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:18.633936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:18.633936 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] PATH_INFO: `/v3/projects/8dedd64815e949ed823f6caead792913` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:18.634770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dedd64815e949ed823f6caead792913)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:18.636698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:18.767460 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dedd64815e949ed823f6caead792913', 'request_id': 'req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.860165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dedd64815e949ed823f6caead792913', 'request_id': 'req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.866614 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dedd64815e949ed823f6caead792913', 'request_id': 'req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.878336 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] The token cache is being invalidate because project 8dedd64815e949ed823f6caead792913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:18.878857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.879513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-8b9fcf8c-1782-4ce8-80c3-0b5de5b7c0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:18.881264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1345/2730] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:18 2022] DELETE /identity/v3/projects/8dedd64815e949ed823f6caead792913 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:18.886323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:18.886789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:18.887043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:18.907094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:18.908402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:18.977145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1386/2731] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:18.985682 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:18.986052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:18.986364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.006081 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:19.007315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:19.016240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1346/2732] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:19.020632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.038557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdc95e-1b6a-4403-8508-7cfe17fc2b81 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.043241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.043913 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.044193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.044470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.045399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:33:19.045949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.047592 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.053465 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.055005 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:19.061737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1387/2733] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:33:19.065785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.078101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbc8bf-dcdd-444c-8284-21cdda999894 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.082870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.083532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.083811 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.084917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.084917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.086723 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.121406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac71d1-19fa-4e6f-987e-75877dfe673b None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.125307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.125999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.126273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.126550 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.128403 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:19.137718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.139839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.147918 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1347/2734] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:33:19.192101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1388/2735] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:33:19 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:33:19.195798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.209109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e844f3-5923-4ec5-988a-8b9ff5a7f2f4 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.270704 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:19.284706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.285388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.285710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.286018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.286720 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.289763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.397833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1348/2736] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:33:19 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:19.403726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.413424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad0fba-293f-4b59-ae14-5f44132ecdfc admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.418125 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.418829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.419106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.419380 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.420107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.421733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.431851 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1389/2737] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:19.436360 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.446523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182915-d6b2-487e-ad6f-362df62f75c2 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.453331 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.454032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.454315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.454588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.455408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.457000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2b1b7-7885-4977-ba86-9b1eebcb4b65 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.467773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1349/2738] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:19.471997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.481881 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d0da-2493-4897-bad6-a79b09e380bf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.486973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.487866 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.488149 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.488424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] PATH_INFO: `/v3/projects/07253b5b67eb4e80b55bd076417015e5/users/6fc8f7f8554942828bf909ce24425a83/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.504364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07253b5b67eb4e80b55bd076417015e5, user_id=6fc8f7f8554942828bf909ce24425a83, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.507043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.575078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1390/2739] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:33:19 2022] PUT /identity/v3/projects/07253b5b67eb4e80b55bd076417015e5/users/6fc8f7f8554942828bf909ce24425a83/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:19.586146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.586641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.586737 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.613256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] MFA Rules not processed for user `6fc8f7f8554942828bf909ce24425a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:19.614507 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:19.679811 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1350/2740] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:19.692386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.694594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:19.765234 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ea5b4-4c51-44d9-8eea-e3761dc658f4 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.769340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.770035 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.770323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.770586 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.782083 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.783542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:19.801754 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1391/2741] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:19.816698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:19.899933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96a147-65fb-40a2-8fa1-1f1175ceb10f None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:19.905092 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:19.906014 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:19.906307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:19.906587 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] PATH_INFO: `/v3/users/6fc8f7f8554942828bf909ce24425a83` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:19.907816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc8f7f8554942828bf909ce24425a83)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:19.909773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:20.017943 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:20.019857 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:20.070813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:20.115160 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f92570-8ac2-4238-b00b-8d951b419b24 service cinder] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:20.122941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:20.124349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:20.124601 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:20.124864 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:20.127159 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:20.136229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc8f7f8554942828bf909ce24425a83'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:20.136921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc8f7f8554942828bf909ce24425a83'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:20.137553 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc8f7f8554942828bf909ce24425a83'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:20.145117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:20.150432 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c190564-60c4-4f25-9443-4b72495b10d6 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:20.150965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc8f7f8554942828bf909ce24425a83'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:20.155025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:20.174736 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1392/2742] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:33:20.252767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc8f7f8554942828bf909ce24425a83'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:20.271652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1351/2743] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:19 2022] DELETE /identity/v3/users/6fc8f7f8554942828bf909ce24425a83 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:20.275975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:20.276276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:20.276564 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:20.308607 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:20.310057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:20.370902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1393/2744] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:20.381186 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:20.382663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:20.443010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b266-4bbe-4576-9d69-6c063f35f3a4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:20.446638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:20.447431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:20.447721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:20.448001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:20.457546 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:20.459130 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cab20c-6317-4f27-955a-de51b083643b service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:20.469861 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1352/2745] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:20.877426 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:20.878907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:20.891769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a774b9c-9ee1-4c0d-8d8c-495fb0314258 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:20.896751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:20.897610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:20.897872 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:20.898150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] PATH_INFO: `/v3/projects/07253b5b67eb4e80b55bd076417015e5` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:20.899364 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07253b5b67eb4e80b55bd076417015e5)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:20.901286 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.017367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07253b5b67eb4e80b55bd076417015e5', 'request_id': 'req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:21.023322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07253b5b67eb4e80b55bd076417015e5', 'request_id': 'req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:21.099680 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07253b5b67eb4e80b55bd076417015e5', 'request_id': 'req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:21.111258 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] The token cache is being invalidate because project 07253b5b67eb4e80b55bd076417015e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:21.111548 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:21.112297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-3bff3fcb-2cb7-4f82-bbd6-bb25ab1d064a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:21.113869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1394/2746] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:20 2022] DELETE /identity/v3/projects/07253b5b67eb4e80b55bd076417015e5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:21.118733 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.119222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.119323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.137663 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:21.139643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:21.198389 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1353/2747] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:21.206819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.207208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.207557 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.226633 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:21.227846 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:21.236543 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1395/2748] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:21.240647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.250282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ee62d-d8b4-47dc-a9da-c9289360b194 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.254781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.255422 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.255702 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.255972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.256684 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:33:21.256988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.258598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.270537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1354/2749] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:33:21.274960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.284852 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cce03-e3a9-4a22-85dd-55d639e75d18 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.289490 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.290165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.290454 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.290735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.291415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.293343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.376139 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1396/2750] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:33:21 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:21.379845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.390960 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb37bdc-43cd-4b31-9525-2a8b2483f335 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.447223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.447895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.448188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.448468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.449165 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.451705 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.461148 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:21.559609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1355/2751] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:33:21 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:21.560998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.572082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b33a9-9a82-4ae5-8d63-63416b5b4066 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.577786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.578576 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.578931 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.579275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.580091 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.581855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.597725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1397/2752] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:21.598940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.610010 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf725d-9506-4358-8d0c-6cdf08358bbb admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.615150 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.615851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.616318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.616603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.617351 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.619080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d53f7-de0f-404f-9e00-1d32788e21f4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.633222 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1356/2753] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:21.637448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.643430 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:21.648981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c0a4-0068-46e5-905a-11aba91ecc7c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:21.654335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:21.655236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.655515 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.655789 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] PATH_INFO: `/v3/projects/6794232b78ed4bb8922d2de3296027ca/users/d1b9b415d3d847cd828fc7028b566cfc/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.671469 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6794232b78ed4bb8922d2de3296027ca, user_id=d1b9b415d3d847cd828fc7028b566cfc, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:21.674194 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:21.740782 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1398/2754] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:33:21 2022] PUT /identity/v3/projects/6794232b78ed4bb8922d2de3296027ca/users/d1b9b415d3d847cd828fc7028b566cfc/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:33:21.751856 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:21.752147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:21.752426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:21.902841 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] MFA Rules not processed for user `d1b9b415d3d847cd828fc7028b566cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:21.904732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:21.968969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1357/2755] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:21.979498 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:21.981173 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:22.038099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0a53-7254-4394-9404-f3f1c16ba9ee admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:22.041784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:22.042550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:22.042842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:22.043120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:22.051949 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:22.053503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776715c3-f74c-4386-8a6a-8c734978fe2a service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:22.062950 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1399/2756] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:31.966028 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=39 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:32.058305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:33.424629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:33.486974 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fb51c-f3e1-4d76-aea8-4319457a5e2e None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:33.491544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:33.492406 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:33.492687 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:33.492958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] PATH_INFO: `/v3/users/d1b9b415d3d847cd828fc7028b566cfc` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:33.494147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b9b415d3d847cd828fc7028b566cfc)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:33.496038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:33.644439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b9b415d3d847cd828fc7028b566cfc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:33.645261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b9b415d3d847cd828fc7028b566cfc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:33.646167 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b9b415d3d847cd828fc7028b566cfc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:33.653080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b9b415d3d847cd828fc7028b566cfc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:33.732327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b9b415d3d847cd828fc7028b566cfc'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:33.750848 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1358/2757] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:33:33 2022] DELETE /identity/v3/users/d1b9b415d3d847cd828fc7028b566cfc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:33.755391 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:33.755901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:33.755901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:33.773092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:33.774318 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:33.833894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1400/2758] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:33.843535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:33.844927 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:33.901591 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e5f4-744c-43ca-b515-b9ad05cb0da7 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:33.905115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:33.905772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:33.906052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:33.906323 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:33.915808 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:33.917211 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b2ccc-9744-428d-8ee6-3373be41f788 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:33.927548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1359/2759] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:34.353272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:34.354769 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:34.370207 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a510e-a378-4c3e-973d-aebd43d968c1 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:34.375684 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:34.377503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.377947 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.378359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] PATH_INFO: `/v3/projects/6794232b78ed4bb8922d2de3296027ca` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.379732 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6794232b78ed4bb8922d2de3296027ca)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:34.381735 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:34.512275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6794232b78ed4bb8922d2de3296027ca', 'request_id': 'req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:34.518359 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6794232b78ed4bb8922d2de3296027ca', 'request_id': 'req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:34.585419 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6794232b78ed4bb8922d2de3296027ca', 'request_id': 'req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:34.596780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] The token cache is being invalidate because project 6794232b78ed4bb8922d2de3296027ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:33:34.597612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:34.597870 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-082f3a8e-c8f2-4f2b-ad11-2e1b44e42020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:33:34.599476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1401/2760] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:33:34 2022] DELETE /identity/v3/projects/6794232b78ed4bb8922d2de3296027ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:34.604551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.605038 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.605140 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.623294 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:34.629816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:34.641978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:34.683203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1360/2761] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:34.691486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.691776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.692059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.710639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:34.711836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:34.719730 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1402/2762] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:33:34.723979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:34.733411 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c949568-c41c-46fc-a8a4-5e6e76d5a6fd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:34.738713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:34.739363 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.739647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.739924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.742413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:33:34.742413 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:34.742639 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:34.754817 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1361/2763] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:33:34.759278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:34.768934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b28c-d4ba-4b4e-990b-03d33e6e55eb None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:34.773978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:34.774627 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.774915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.775195 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.775884 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:34.777828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:34.872470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1403/2764] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:33:34 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:33:34.876396 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:34.887295 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecb07-a813-4228-8309-bf909ab6fb20 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:34.944434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:34.945090 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:34.945374 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:34.945677 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:34.946364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:34.948258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:35.054969 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1362/2765] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:33:34 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:33:35.059102 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:35.070130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721aee-76af-42cb-a05b-ba3420e20481 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:35.074741 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:35.075393 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:35.075785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:35.076068 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:35.076788 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:35.078484 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:35.088639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1404/2766] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:35.092723 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:35.103317 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed36e89-98ff-4349-b3be-062ebd6c6730 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:35.108065 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:35.108716 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:35.109000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:35.109276 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:35.110050 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:35.112713 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86715b27-4272-426a-921f-ed9077f2411a admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:35.123184 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1363/2767] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:33:35.127278 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:35.137265 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31cd9-3e21-48c9-9a1d-35d076ef8655 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:35.141861 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:35.142737 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:35.143016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:35.143297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] PATH_INFO: `/v3/projects/403804d358314ac78354231364c03413/users/02d8995e307a43069970c1e6d808b34e/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:35.158838 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403804d358314ac78354231364c03413, user_id=02d8995e307a43069970c1e6d808b34e, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:35.161572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:35.231208 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1405/2768] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:33:35 2022] PUT /identity/v3/projects/403804d358314ac78354231364c03413/users/02d8995e307a43069970c1e6d808b34e/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:33:35.242436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253756-0ee6-4532-9bd5-b82272daf424 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:35.242730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253756-0ee6-4532-9bd5-b82272daf424 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:35.243016 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253756-0ee6-4532-9bd5-b82272daf424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:35.268712 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-72253756-0ee6-4532-9bd5-b82272daf424 None None] MFA Rules not processed for user `02d8995e307a43069970c1e6d808b34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:35.269958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-72253756-0ee6-4532-9bd5-b82272daf424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:35.334267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1364/2769] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:35.344654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:35.347085 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:35.369245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:35.404856 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3861-b362-4ab8-8212-3176ec87ec15 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:35.409316 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:35.409989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:35.410272 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:35.410547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:35.418901 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:35.420325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a14cf-1e74-4ea7-93e4-aec857e060db service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:35.429596 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1406/2770] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:33:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:33:37.103964 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:37.104563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:37.104563 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:37.123344 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] MFA Rules not processed for user `02d8995e307a43069970c1e6d808b34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:37.124594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:37.132056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1365/2771] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:33:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:45.453953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=17 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:47.117226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:33:55.813046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768d6d-3e1b-4db2-bae7-67a794b4bdec None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:55.814075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768d6d-3e1b-4db2-bae7-67a794b4bdec None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:55.814075 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768d6d-3e1b-4db2-bae7-67a794b4bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:55.832095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-65768d6d-3e1b-4db2-bae7-67a794b4bdec None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:55.833287 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-65768d6d-3e1b-4db2-bae7-67a794b4bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:55.888016 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1407/2772] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:33:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:55.909194 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:55.910633 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:55.991190 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558af1-f68e-49d8-a5f9-60517d6d9f57 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:55.996260 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:55.997166 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:55.997326 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:55.997455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:56.005845 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:56.007489 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:56.015586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1366/2773] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:33:56.898835 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616686-1ba4-4607-9694-a8f972b39413 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:56.899310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616686-1ba4-4607-9694-a8f972b39413 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:56.899408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616686-1ba4-4607-9694-a8f972b39413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:56.917912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0c616686-1ba4-4607-9694-a8f972b39413 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:56.919041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0c616686-1ba4-4607-9694-a8f972b39413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:56.926221 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1408/2774] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:56.938122 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:56.948915 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4fe-2478-4143-8789-cd8ab54f4250 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:56.953900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:56.954714 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:56.954994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:56.955271 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:56.963885 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:56.965472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:56.973304 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1367/2775] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:33:57.533065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09013-6651-4b59-98b9-439dae3c00e5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:57.533382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09013-6651-4b59-98b9-439dae3c00e5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:57.533685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b09013-6651-4b59-98b9-439dae3c00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:57.552612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-a3b09013-6651-4b59-98b9-439dae3c00e5 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:57.553898 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-a3b09013-6651-4b59-98b9-439dae3c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:57.561475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1409/2776] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:33:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:57.573533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:57.584693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5e13-b563-4d76-9ec8-ffb93e51cb6a service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:57.589860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:57.590496 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:57.590781 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:57.591062 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:57.600068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:57.601629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:57.609844 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1368/2777] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:33:58.145537 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:58.146825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:58.147034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:58.164922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:33:58.166152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:33:58.173332 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1410/2778] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:33:58.186283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:33:58.197535 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4aea-f653-442e-b52a-eb0be659490e service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:33:58.202709 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:33:58.208547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:33:58.208547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:33:58.208547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:33:58.212468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:33:58.214141 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb7e38-2783-4dc5-ba63-b4d94246c7dd service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:33:58.222274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1369/2779] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:34:00.762064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:00.825029 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2d178-5e1d-448c-9254-c2ec6ed6c9c0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:00.829584 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:00.830464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:00.830752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:00.831064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] PATH_INFO: `/v3/users/02d8995e307a43069970c1e6d808b34e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:00.832296 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d8995e307a43069970c1e6d808b34e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:00.834322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:01.009305 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d8995e307a43069970c1e6d808b34e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.021199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d8995e307a43069970c1e6d808b34e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.021904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d8995e307a43069970c1e6d808b34e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.022523 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d8995e307a43069970c1e6d808b34e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.029261 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d8995e307a43069970c1e6d808b34e'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.116516 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1411/2780] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:34:00 2022] DELETE /identity/v3/users/02d8995e307a43069970c1e6d808b34e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:34:01.120951 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.121433 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.121534 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.139390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:01.140592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:01.198461 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1370/2781] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:01.208092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:01.210027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:01.216506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:01.267133 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843ac3-410a-449b-a6e8-668aada0f307 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:01.271962 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:01.272960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.273289 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.273585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.282619 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:01.284057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310e0b-b47d-4c84-af6a-6d88be5bc554 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:01.294264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1412/2782] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:34:01.552602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:01.554109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:01.567154 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae47b-06e4-406d-af04-c8f51493817c None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:01.572393 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:01.573297 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.573539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.582667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] PATH_INFO: `/v3/projects/403804d358314ac78354231364c03413` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.582667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=403804d358314ac78354231364c03413)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:01.582667 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:01.685378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:01.695255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403804d358314ac78354231364c03413', 'request_id': 'req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.762069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403804d358314ac78354231364c03413', 'request_id': 'req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.767803 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403804d358314ac78354231364c03413', 'request_id': 'req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.779846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] The token cache is being invalidate because project 403804d358314ac78354231364c03413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:34:01.780136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.780754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-62d7e91a-2c0e-4740-9a3f-12f93934bf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:34:01.782312 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1371/2783] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:34:01 2022] DELETE /identity/v3/projects/403804d358314ac78354231364c03413 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:34:01.787938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.788414 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.788540 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.806806 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:01.807999 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:01.868197 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1413/2784] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:01.876031 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.876327 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.876606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.895029 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:01.897183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:01.905264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1372/2785] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:01.909415 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:01.919663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328e0df-5a23-42be-b3a8-50cea06da8ce None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:01.924291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:01.924941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.925226 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.925506 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.926259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:34:01.926648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:01.928274 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:01.939617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1414/2786] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:34:01.946794 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:01.955991 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c77a53-5cf3-4bf4-9528-2cac8b2da977 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:01.961216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:01.961901 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:01.962188 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:01.962462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:01.963155 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:01.965073 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.044187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1373/2787] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:34:02.048407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:02.058887 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b065-cb28-4266-b6eb-18b94190b0d1 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:02.115824 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:02.116489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.116780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.117065 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.117862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:02.119785 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.202520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1415/2788] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:34:02 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:34:02.206669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:02.217874 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af32a67-9b44-432d-8c6c-dadbd4e66d83 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:02.222594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:02.223253 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.223536 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.223816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.225179 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:02.226910 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.237229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1374/2789] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:34:02.241128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:02.251154 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb1b15-7dc1-486c-a078-6296cb6bd162 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:02.255991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:02.258405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.258405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.258405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.258405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:02.259569 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b635a5-e008-481a-ab05-88f94d021164 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.269566 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1416/2790] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:34:02.274415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:02.284109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2b17-7257-4382-9a46-dcb5948d5b07 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:02.289382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:02.290283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.290566 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.290839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] PATH_INFO: `/v3/projects/b1ea043a23b6470096dc7c7e74ea4247/users/bed028a55ff84550a30374a6baca43e5/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.305962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ea043a23b6470096dc7c7e74ea4247, user_id=bed028a55ff84550a30374a6baca43e5, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:02.308647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.408498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1375/2791] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:34:02 2022] PUT /identity/v3/projects/b1ea043a23b6470096dc7c7e74ea4247/users/bed028a55ff84550a30374a6baca43e5/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:34:02.413906 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7425-bc6d-44dd-b8db-45270b10d4c5 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.414205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7425-bc6d-44dd-b8db-45270b10d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.414489 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7425-bc6d-44dd-b8db-45270b10d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.432233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f1ea7425-bc6d-44dd-b8db-45270b10d4c5 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:02.433445 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f1ea7425-bc6d-44dd-b8db-45270b10d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:02.441797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:02.494594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1417/2792] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:02.504237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:02.506058 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:02.562107 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b6c59-ddb5-4afe-80f2-db7b312541d0 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:02.565860 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:02.566497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:02.566777 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:02.567052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:02.576372 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:02.577891 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:02.587208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1376/2793] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:34:07.653288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:07.654168 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:07.654612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:07.693981 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] MFA Rules not processed for user `bed028a55ff84550a30374a6baca43e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:07.695275 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:07.775810 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1418/2794] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:07.777688 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:07.788390 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44023e-ef3a-439b-80be-c778c49f3466 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:07.793077 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:07.793772 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:07.794063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:07.794342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:07.795052 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:07.796965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:07.917513 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1377/2795] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:34:07 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:34:07.921585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:07.933094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5576-48ca-4ab0-a93d-29b4349a5e97 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:07.992951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:07.993663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:07.993955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:07.994363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:07.995266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:07.997246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:08.104424 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1419/2796] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:34:07 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:34:08.110274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:08.125371 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a70185-c752-4123-8d75-958a9cf4b49d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:08.130497 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:08.131169 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:08.131459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:08.131739 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:08.132480 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:08.134226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:08.146500 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1378/2797] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:34:08.150762 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:08.162248 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a34b-9f1f-4afb-89f8-b8b2addb8179 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:08.175618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:08.175618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:08.175618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:08.175618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] PATH_INFO: `/v3/projects/756b109db7f54e27be2572b6cac76833/users/245edd6798e24fe5a883c35bcfede800/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:08.191622 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b109db7f54e27be2572b6cac76833, user_id=245edd6798e24fe5a883c35bcfede800, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:08.194488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:08.304583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1420/2798] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:34:08 2022] PUT /identity/v3/projects/756b109db7f54e27be2572b6cac76833/users/245edd6798e24fe5a883c35bcfede800/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:34:08.306151 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:08.316554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdde872-95a4-4a11-a5d5-b0a0ba73ba69 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:08.346015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:08.377916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:08.378996 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:08.379289 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:08.379556 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:08.380842 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:08.382506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154a42-a7f3-4f54-b7aa-90e2973f6c32 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:08.393085 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1379/2799] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:34:08.398370 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:08.409328 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac39a-af08-4928-83f8-6039f22e015c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:08.414386 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:08.415291 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:08.415580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:08.415862 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] PATH_INFO: `/v3/projects/756b109db7f54e27be2572b6cac76833/users/245edd6798e24fe5a883c35bcfede800/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:08.419541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b109db7f54e27be2572b6cac76833, user_id=245edd6798e24fe5a883c35bcfede800, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:08.420615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:08.424131 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:08.432413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1421/2800] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:34:08 2022] PUT /identity/v3/projects/756b109db7f54e27be2572b6cac76833/users/245edd6798e24fe5a883c35bcfede800/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:34:13.906594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba54f-69e6-4e7f-a696-e1cb8ff7a762 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:13.907136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba54f-69e6-4e7f-a696-e1cb8ff7a762 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:13.907136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba54f-69e6-4e7f-a696-e1cb8ff7a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:13.937232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-354ba54f-69e6-4e7f-a696-e1cb8ff7a762 None None] MFA Rules not processed for user `245edd6798e24fe5a883c35bcfede800`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:13.938505 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-354ba54f-69e6-4e7f-a696-e1cb8ff7a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:14.009258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1380/2801] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:14.022293 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:14.024107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:14.111915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d5a3d-d1d2-4c65-af36-58e37b113ec7 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:14.117902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:14.120503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:14.120503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:14.120503 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:14.187205 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:14.188733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:14.198625 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1422/2802] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:34:14.470030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5d2-5018-4d9a-ae45-0a0b0414553e None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:14.470395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5d2-5018-4d9a-ae45-0a0b0414553e None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:14.470745 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5d2-5018-4d9a-ae45-0a0b0414553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:14.489237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-4962b5d2-5018-4d9a-ae45-0a0b0414553e None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:14.490498 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-4962b5d2-5018-4d9a-ae45-0a0b0414553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:14.549753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1381/2803] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:14.562798 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:14.564245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:14.640918 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96596bb-b056-44a0-90e3-3e4eb21a1494 service glance] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:14.646938 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:14.647758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:14.648042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:14.648329 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:14.657171 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:14.658948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a797d2f-251b-4f4f-a58f-168236c5a741 service swift] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:14.668262 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1423/2804] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:34:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 09:34:24.542721 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=75 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:24.665044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=91 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:24.936722 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:24.937118 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:24.937452 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:24.955601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] MFA Rules not processed for user `bed028a55ff84550a30374a6baca43e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:24.956802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:24.964518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1382/2805] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:34:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:28.423808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:28.424353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:28.424353 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:28.442276 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:34:28.443534 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:28.451556 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1424/2806] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:34:28.465027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:28.478890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612037-1a92-4059-986f-ff45fc5f6190 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:28.484008 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:28.484670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:28.484957 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:28.485235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:28.498109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:28.498109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:28.504467 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1383/2807] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:34:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:34:38.436973 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:38.501043 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=9 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:34:46.937585 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:46.939093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:47.021902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438745-f031-4cf8-96ba-7cbb1639a3b3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:47.027632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:47.028297 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:47.028580 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:47.028858 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:47.030957 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:47.046988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:47.048618 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:47.062757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1425/2808] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:34:54.880470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:54.934532 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7855-439e-4747-93dc-726f6429b7b7 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:54.938216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:54.938857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:54.939143 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:54.939428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:54.948767 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:54.950235 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086c8e5-d28d-4da8-b5bd-d24182a47b35 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:54.960205 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1384/2809] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:34:56.664802 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:34:56.666461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:56.680327 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8711-a509-4e84-8305-e8b902f4e0d2 service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:34:56.686005 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:34:56.686661 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:34:56.686951 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:34:56.687236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:34:56.689003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:34:56.752991 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:34:56.754770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:34:56.764685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1426/2810] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:34:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:35:04.955470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=26 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:06.760238 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=62 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:16.616224 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb97d-61cf-4de3-823d-c72d81d86b4f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:16.616766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb97d-61cf-4de3-823d-c72d81d86b4f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:16.617454 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deb97d-61cf-4de3-823d-c72d81d86b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:16.634631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f8deb97d-61cf-4de3-823d-c72d81d86b4f None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:16.637108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f8deb97d-61cf-4de3-823d-c72d81d86b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:16.643876 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1385/2811] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:35:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:35:16.665819 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:16.678007 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e54-e1e8-41d4-a6d9-7436593418c2 service nova] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:16.683972 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:16.684616 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:16.684902 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:16.685181 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:16.693264 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:16.694900 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9dea0-f504-440c-82b0-0c692bfff4e5 service swift] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:16.702793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1427/2812] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:35:26.629730 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:26.699659 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=6 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:33.705127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be604-b422-4984-8ee0-496a463d9f86 None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:33.705706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be604-b422-4984-8ee0-496a463d9f86 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:33.705947 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3be604-b422-4984-8ee0-496a463d9f86 None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:33.707450 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1386/2813] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:35:33.713308 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d94-d5d8-4e89-b556-e19e6f88dccf None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:33.713845 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d94-d5d8-4e89-b556-e19e6f88dccf None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:33.713956 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d94-d5d8-4e89-b556-e19e6f88dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:33.752048 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ca013d94-d5d8-4e89-b556-e19e6f88dccf None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:33.753371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ca013d94-d5d8-4e89-b556-e19e6f88dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:33.763220 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1428/2814] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:35:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:35:33.775601 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3be604-b422-4984-8ee0-496a463d9f86 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:33.786583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3be604-b422-4984-8ee0-496a463d9f86 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:33.790625 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dad643f7b3004fafb5d22ec1360ad9e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:33.791404 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:33.791689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:33.791962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:33.802027 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:33.803434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a237342-16a3-43e2-ba22-882a7f235d67 service glance] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:33.814866 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1387/2815] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:35:34.006461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d234-19ce-4973-8bbe-80acd032b37d None None] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.006756 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d234-19ce-4973-8bbe-80acd032b37d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.007031 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d234-19ce-4973-8bbe-80acd032b37d None None] PATH_INFO: `/` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.008429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1429/2816] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:35:34.013272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64da0-83be-4d5a-a8ef-8cb8f057353f None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.013588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64da0-83be-4d5a-a8ef-8cb8f057353f None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.013913 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64da0-83be-4d5a-a8ef-8cb8f057353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.050115 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-cba64da0-83be-4d5a-a8ef-8cb8f057353f None None] MFA Rules not processed for user `3575daa9fded4cfb9686c817753f246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:34.051318 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-cba64da0-83be-4d5a-a8ef-8cb8f057353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:34.058638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1388/2817] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:35:34.070343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d234-19ce-4973-8bbe-80acd032b37d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:34.081478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d234-19ce-4973-8bbe-80acd032b37d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:34.085021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:34.085699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.085988 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.086599 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.093726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:34.095162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e335-30dc-4bde-8d23-d09e54a3ef79 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:34.103461 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1430/2818] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:35:34.186635 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76744e-25c5-4c0a-9f22-50b181bf6bdd None None] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.186926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76744e-25c5-4c0a-9f22-50b181bf6bdd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.187202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76744e-25c5-4c0a-9f22-50b181bf6bdd None None] PATH_INFO: `/` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.188564 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1389/2819] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 21 09:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 09:35:34.194107 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb402-7537-4214-b4bb-a63eba4e5d5a None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.194404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb402-7537-4214-b4bb-a63eba4e5d5a None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.194690 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb402-7537-4214-b4bb-a63eba4e5d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.213325 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-1dbcb402-7537-4214-b4bb-a63eba4e5d5a None None] MFA Rules not processed for user `923ba7b9f0414b6e8d9a3ad4cb256ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:34.214656 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-1dbcb402-7537-4214-b4bb-a63eba4e5d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:34.223895 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1431/2820] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 21 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:35:34.234877 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76744e-25c5-4c0a-9f22-50b181bf6bdd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:34.246437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76744e-25c5-4c0a-9f22-50b181bf6bdd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:34.249935 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:34.250641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:34.250924 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:34.251195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:34.262114 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:34.263537 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:34.274718 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1390/2821] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:35:37.048161 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588ac1-4df9-4998-bbaf-87d8ae3012b9 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:37.048639 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588ac1-4df9-4998-bbaf-87d8ae3012b9 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:37.050055 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588ac1-4df9-4998-bbaf-87d8ae3012b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:37.067236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-bf588ac1-4df9-4998-bbaf-87d8ae3012b9 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:37.068453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-bf588ac1-4df9-4998-bbaf-87d8ae3012b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:37.076371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1432/2822] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 21 09:35:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 09:35:37.088084 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:37.100503 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a1fb-3ad1-4e51-acfe-eab8d65999fe service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:37.106530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:37.111119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:37.111119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:37.111119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:37.117001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:37.119679 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:37.128069 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1391/2823] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:35:47.062199 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=21 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:47.124725 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=27 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:35:55.516539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:55.517050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:55.517162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:55.536233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:35:55.537442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:35:55.545046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1433/2824] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:35:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:35:55.557579 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:35:55.569182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535441d0-7fb4-481d-8cd4-ca975268516d service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:35:55.575001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:35:55.575506 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:35:55.575798 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:35:55.576076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:35:55.584593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:35:55.586215 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:35:55.595307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1392/2825] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:36:05.531027 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:36:05.592001 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=6 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:36:36.660233 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:36:36.661666 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:36:36.731073 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a19c-5619-4b35-8e13-7aba44dedc35 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:36:36.736188 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:36:36.736840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:36:36.737126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:36:36.737406 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:36:36.739203 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:36:36.750583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:36:36.752155 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:36:36.761985 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1434/2826] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:36:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:36:46.757916 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=32 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:01.660642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:01.662134 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:01.674958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997074c2-c4ba-4d38-8342-2222a18142f8 service swift] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:01.678510 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:01.679147 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:01.679442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:01.679724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:01.681445 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:01.744086 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:01.745583 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:01.755366 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1393/2827] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:05.104365 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:05.115975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42638b-b4bd-4370-a476-c0c5b2da1722 service placement] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:05.121323 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:05.122006 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:05.122322 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:05.122629 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:05.124613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:05.136407 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:05.138043 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:05.149398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1435/2828] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:05.233650 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:05.235203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:05.250369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02586b8b-90c5-4246-bb03-84bb3a80ae9c service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:05.255307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:05.256187 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:05.256474 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:05.256754 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] PATH_INFO: `/v3/users/e34d5f6de8f64902b3126e4d464d34a3` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:05.257979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34d5f6de8f64902b3126e4d464d34a3)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:05.259925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:05.426364 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34d5f6de8f64902b3126e4d464d34a3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.427015 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34d5f6de8f64902b3126e4d464d34a3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.427616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34d5f6de8f64902b3126e4d464d34a3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.434417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34d5f6de8f64902b3126e4d464d34a3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.509449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1f9c9818-f75a-4a15-99f4-fe54077e4183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34d5f6de8f64902b3126e4d464d34a3'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.527740 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1394/2829] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:05 2022] DELETE /identity/v3/users/e34d5f6de8f64902b3126e4d464d34a3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:05.814517 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:05.826093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac52bc-5b90-4110-a416-c5bc590296a7 service placement] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:05.883301 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:05.884164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:05.884456 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:05.884725 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] PATH_INFO: `/v3/projects/6315f0cda7d442c4a345d2015bb48642` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:05.885932 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6315f0cda7d442c4a345d2015bb48642)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:05.887828 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:05.984955 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6315f0cda7d442c4a345d2015bb48642', 'request_id': 'req-8372c1da-d64d-49a6-98d6-bf6d59a09786'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:05.990672 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6315f0cda7d442c4a345d2015bb48642', 'request_id': 'req-8372c1da-d64d-49a6-98d6-bf6d59a09786'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:06.058842 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6315f0cda7d442c4a345d2015bb48642', 'request_id': 'req-8372c1da-d64d-49a6-98d6-bf6d59a09786'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:06.071282 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] The token cache is being invalidate because project 6315f0cda7d442c4a345d2015bb48642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:06.071575 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:06.072310 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-8372c1da-d64d-49a6-98d6-bf6d59a09786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:06.073908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1436/2830] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:05 2022] DELETE /identity/v3/projects/6315f0cda7d442c4a345d2015bb48642 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:06.079049 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.079365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.079640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.097598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:06.098778 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:06.156520 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1395/2831] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:06.164093 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.164572 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.164692 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.182940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:06.184130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:06.192472 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1437/2832] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:06.196472 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.206045 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daacc7-4152-453b-9503-2de087dd90cd None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.210629 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.211309 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.211593 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.211867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.212588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:37:06.212895 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.214599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.216110 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:06.227547 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1396/2833] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:37:06.231869 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.241964 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b7dda-e609-4ba4-987d-7ef2a3ae1c23 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.246698 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.247349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.247669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.247954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.248685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.250648 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.309060 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1438/2834] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:06 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:06.313586 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.323340 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81837598-a242-476f-b36b-dca543a2207f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.379002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.379660 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.379940 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.380217 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.380890 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.382880 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.470554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1397/2835] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:06 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:37:06.474734 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.485529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087925c4-2179-4d5f-a45c-2e41e519ba50 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.490156 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.490832 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.491120 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.491399 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.492119 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.493765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.504112 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1439/2836] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:06.508100 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.519044 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02840-5d7c-4a67-bf4a-864dfccdbbfe admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.523690 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.524342 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.524631 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.524909 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.525681 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.527249 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dba19-f0cf-4135-bec9-63b38b691422 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.537703 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1398/2837] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:06.541526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.551313 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99822cb-a7cb-4588-a49b-5f5a21bf46a3 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.555936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.556805 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.557092 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.557367 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] PATH_INFO: `/v3/projects/b8dbc4a722d846cc959f17e4e7ec2dc2/users/0c63443efc5c4e5bbd9daf57d39ab6fe/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.571912 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dbc4a722d846cc959f17e4e7ec2dc2, user_id=0c63443efc5c4e5bbd9daf57d39ab6fe, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.574532 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.647363 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1440/2838] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:06 2022] PUT /identity/v3/projects/b8dbc4a722d846cc959f17e4e7ec2dc2/users/0c63443efc5c4e5bbd9daf57d39ab6fe/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:06.659554 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.659850 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.660136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.686079 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] MFA Rules not processed for user `0c63443efc5c4e5bbd9daf57d39ab6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:06.687283 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:06.750425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1399/2839] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:06.761752 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:06.763444 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:06.778590 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:06.839953 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05589ae-e9c8-4e5a-aa20-9e31b5de1d55 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:06.846099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '923ba7b9f0414b6e8d9a3ad4cb256ebf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:06.846904 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:06.847196 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:06.847478 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:06.855374 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:06.857021 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0864-6a46-453c-b85f-b0e819a6c478 service nova] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:06.866780 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1441/2840] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:10.078024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:10.136007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f614e-3d51-49ad-b103-051531b159ca None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:10.141305 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:10.142195 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:10.142499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:10.142766 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] PATH_INFO: `/v3/users/0c63443efc5c4e5bbd9daf57d39ab6fe` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:10.144203 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c63443efc5c4e5bbd9daf57d39ab6fe)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:10.146139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:10.148361 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:10.354362 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c63443efc5c4e5bbd9daf57d39ab6fe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:10.354985 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c63443efc5c4e5bbd9daf57d39ab6fe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:10.355606 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c63443efc5c4e5bbd9daf57d39ab6fe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:10.363428 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c63443efc5c4e5bbd9daf57d39ab6fe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:10.435254 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c63443efc5c4e5bbd9daf57d39ab6fe'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:10.453795 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1400/2841] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:10 2022] DELETE /identity/v3/users/0c63443efc5c4e5bbd9daf57d39ab6fe => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:10.458568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:10.459059 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:10.459164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:10.476507 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:10.477765 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:10.536773 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1442/2842] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:10.546906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:10.548316 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:10.603548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591d7d-c9ad-4cfa-ae55-c379b9112086 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:10.607182 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:10.608256 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:10.608533 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:10.608900 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:10.617801 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:10.619209 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb289e-8b63-421c-94de-6842aee0b3c1 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:10.629225 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1401/2843] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:11.027519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.029103 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:11.041933 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da0f5-669e-4b8f-9a51-1da54bc0c97e None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.046669 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.047571 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.047860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.048143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] PATH_INFO: `/v3/projects/b8dbc4a722d846cc959f17e4e7ec2dc2` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.049379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8dbc4a722d846cc959f17e4e7ec2dc2)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.051429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.158653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dbc4a722d846cc959f17e4e7ec2dc2', 'request_id': 'req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:11.164240 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dbc4a722d846cc959f17e4e7ec2dc2', 'request_id': 'req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:11.243612 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dbc4a722d846cc959f17e4e7ec2dc2', 'request_id': 'req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:11.254742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] The token cache is being invalidate because project b8dbc4a722d846cc959f17e4e7ec2dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:11.255095 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:11.255733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-ba06d6fb-b62b-463e-bc71-4ad1e88ee41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:11.257249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1443/2844] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:11 2022] DELETE /identity/v3/projects/b8dbc4a722d846cc959f17e4e7ec2dc2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:37:11.262218 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.262698 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.262815 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.281431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:11.282658 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:11.344227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1402/2845] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:11.352150 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.352442 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.352721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.370970 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:11.372210 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:11.380770 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1444/2846] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:11.390423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.400377 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82c13-9d3b-47b6-a44d-54b276eee082 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.404979 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.405668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.405963 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.406245 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.406971 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:37:11.407280 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.408933 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.420290 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1403/2847] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:37:11.424451 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.433542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe480-fb0c-4394-80af-702ba2ff10e3 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.438848 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.439499 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.439786 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.440066 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.440751 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.442691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.456165 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:11.541833 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1445/2848] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:37:11.546223 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.556286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652812-9c11-4bbb-981f-d12381a60157 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.564598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:11.612865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.613552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.613868 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.614341 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.615219 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.617582 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.700548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1404/2849] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:11.705255 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.715673 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fafbc-e44d-40c3-85f5-5a0a2c602daf admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.720446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.721099 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.721409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.721724 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.722446 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.724077 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.734813 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1446/2850] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:11.738872 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.748906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd153-fd41-4f80-be41-b63667b7d3ab admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.754266 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.754921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.755210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.755491 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.756226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.757865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5c55-7839-4de0-b69a-0e35a07ced47 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.768652 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1405/2851] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:11.772793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:11.783529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f9a8a-a0e0-47bb-8133-d41b7a377739 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:11.788183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:11.789057 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.789343 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.789653 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] PATH_INFO: `/v3/projects/9efb734d5f8a4cf790c61950949d3c19/users/dd5a4c33a8e34dd599002e4c0abf6f63/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.804279 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efb734d5f8a4cf790c61950949d3c19, user_id=dd5a4c33a8e34dd599002e4c0abf6f63, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:11.806960 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:11.872410 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1447/2852] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:11 2022] PUT /identity/v3/projects/9efb734d5f8a4cf790c61950949d3c19/users/dd5a4c33a8e34dd599002e4c0abf6f63/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:11.886102 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:11.886446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:11.886727 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:11.913992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] MFA Rules not processed for user `dd5a4c33a8e34dd599002e4c0abf6f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:11.915183 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:11.979255 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1406/2853] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:11.983800 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.047886 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b372-5a0b-4925-a4ba-94a0fe6a7b01 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.052604 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.053259 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.053547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.053905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.054597 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.056551 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.125706 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1448/2854] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:11 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:12.129854 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.141168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072eddf-8275-4784-8083-2311e11d54a4 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.195968 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.196638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.196949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.197229 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.197966 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.199902 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.286756 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1407/2855] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:12 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:37:12.290715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.301294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c08e-04c0-4f94-9adf-6e8989444681 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.306726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.307401 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.307693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.307977 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.308714 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.310434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.321891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1449/2856] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:12.326146 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.337238 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ba83-0840-46dc-9628-57dac42d470f admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.341769 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.342643 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.342920 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.343191 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] PATH_INFO: `/v3/projects/68f187ef611942e9b2483ed7a4b93cbc/users/4b003ed4ca0d49c195c176cfb0361277/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.346267 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:12.357388 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f187ef611942e9b2483ed7a4b93cbc, user_id=4b003ed4ca0d49c195c176cfb0361277, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.360120 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.452365 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1408/2857] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:12 2022] PUT /identity/v3/projects/68f187ef611942e9b2483ed7a4b93cbc/users/4b003ed4ca0d49c195c176cfb0361277/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:12.457116 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.467094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f76ac9-cfb8-4e3f-935c-8e941c548cec admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.524094 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.524767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.525064 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.525339 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.526104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.527715 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7cc23-0030-43bc-ba55-978e22d2c8e6 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.537352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1450/2858] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:12.541770 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.552903 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b0c2a-9476-49b9-ba07-48b4f5faa78e admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.557552 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.558458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.558747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.559025 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] PATH_INFO: `/v3/projects/68f187ef611942e9b2483ed7a4b93cbc/users/4b003ed4ca0d49c195c176cfb0361277/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.561063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f187ef611942e9b2483ed7a4b93cbc, user_id=4b003ed4ca0d49c195c176cfb0361277, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.564693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.574906 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1409/2859] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:12 2022] PUT /identity/v3/projects/68f187ef611942e9b2483ed7a4b93cbc/users/4b003ed4ca0d49c195c176cfb0361277/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:12.585037 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.585529 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.585647 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.613082 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] MFA Rules not processed for user `4b003ed4ca0d49c195c176cfb0361277`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:12.614349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:12.631270 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:12.682070 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1451/2860] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:12.694080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:12.695734 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:12.751953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cc43b-31c3-4769-8c4f-d2dee1d1a172 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:12.755646 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:12.756284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:12.756569 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:12.756846 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:12.765818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:12.767232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0749d7d-9a48-4bd2-8ac2-eb1fe22f25a0 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:12.776814 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1410/2861] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:13.680615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:13.743121 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d214ce-c08d-45d8-adea-056ba9f92812 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:13.747687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:13.748550 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:13.748840 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:13.749122 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] PATH_INFO: `/v3/users/dd5a4c33a8e34dd599002e4c0abf6f63` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:13.750404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5a4c33a8e34dd599002e4c0abf6f63)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:13.752336 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:13.900046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5a4c33a8e34dd599002e4c0abf6f63'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:13.911971 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5a4c33a8e34dd599002e4c0abf6f63'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:13.912632 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5a4c33a8e34dd599002e4c0abf6f63'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:13.913236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5a4c33a8e34dd599002e4c0abf6f63'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:13.920026 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5a4c33a8e34dd599002e4c0abf6f63'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.000609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1452/2862] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:13 2022] DELETE /identity/v3/users/dd5a4c33a8e34dd599002e4c0abf6f63 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:14.005116 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:14.005647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:14.005809 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:14.023418 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:14.024623 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:14.083124 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1411/2863] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:14.092662 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:14.094888 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:14.129531 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:14.151214 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693b26-c01e-4ab6-848e-f5e8485e6485 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:14.154948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:14.155608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:14.156475 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:14.156758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:14.166299 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:14.167729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:14.177405 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1453/2864] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:14.596965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:14.598484 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:14.612605 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed85e-a5f3-4d92-b7b6-3afeba21c6a4 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:14.617468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:14.618857 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:14.619319 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:14.619603 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] PATH_INFO: `/v3/projects/9efb734d5f8a4cf790c61950949d3c19` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:14.620832 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efb734d5f8a4cf790c61950949d3c19)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:14.622853 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:14.721087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efb734d5f8a4cf790c61950949d3c19', 'request_id': 'req-2e2e7f4b-b096-473f-86a1-51d490fef524'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.801088 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efb734d5f8a4cf790c61950949d3c19', 'request_id': 'req-2e2e7f4b-b096-473f-86a1-51d490fef524'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.807018 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efb734d5f8a4cf790c61950949d3c19', 'request_id': 'req-2e2e7f4b-b096-473f-86a1-51d490fef524'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.814609 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:14.819128 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] The token cache is being invalidate because project 9efb734d5f8a4cf790c61950949d3c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:14.819421 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.820054 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:14.821676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1412/2865] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:14 2022] DELETE /identity/v3/projects/9efb734d5f8a4cf790c61950949d3c19 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:14.825554 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:14.835428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca30dc-51dc-40a0-b27f-3d28e82b2439 service neutron] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:14.892697 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:14.893892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:14.894179 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:14.894460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] PATH_INFO: `/v3/users/4b003ed4ca0d49c195c176cfb0361277` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:14.895655 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b003ed4ca0d49c195c176cfb0361277)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:14.897588 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:15.085757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b003ed4ca0d49c195c176cfb0361277'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.097793 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b003ed4ca0d49c195c176cfb0361277'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.098452 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b003ed4ca0d49c195c176cfb0361277'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.099058 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b003ed4ca0d49c195c176cfb0361277'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.105776 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-e58b5930-a9db-4f54-94dd-c5e5f620879d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b003ed4ca0d49c195c176cfb0361277'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.169334 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1454/2866] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:14 2022] DELETE /identity/v3/users/4b003ed4ca0d49c195c176cfb0361277 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:15.614264 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:15.615816 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:15.630041 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e7f4b-b096-473f-86a1-51d490fef524 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:15.698599 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:15.699431 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:15.699700 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:15.699989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] PATH_INFO: `/v3/projects/68f187ef611942e9b2483ed7a4b93cbc` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:15.701175 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f187ef611942e9b2483ed7a4b93cbc)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:15.703273 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:15.819335 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f187ef611942e9b2483ed7a4b93cbc', 'request_id': 'req-36bec683-65d4-413a-a466-16c442236292'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.889435 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f187ef611942e9b2483ed7a4b93cbc', 'request_id': 'req-36bec683-65d4-413a-a466-16c442236292'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.896277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f187ef611942e9b2483ed7a4b93cbc', 'request_id': 'req-36bec683-65d4-413a-a466-16c442236292'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.907315 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] The token cache is being invalidate because project 68f187ef611942e9b2483ed7a4b93cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:15.907602 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.908358 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-36bec683-65d4-413a-a466-16c442236292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:15.909921 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1413/2867] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:15 2022] DELETE /identity/v3/projects/68f187ef611942e9b2483ed7a4b93cbc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:15.915855 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:15.916335 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:15.916439 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:15.934463 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:15.935654 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:15.983162 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:15.994467 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1455/2868] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:16.004168 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.004458 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.004735 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.023962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:16.025270 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:16.033343 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1414/2869] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:16.037719 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.047667 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc86c8-4339-4b48-a0bd-695147e44a75 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.053610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.053610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.053610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.053610 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.054581 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:37:16.054892 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.056486 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.069104 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1456/2870] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:37:16.073227 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.083022 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cf02-8929-4543-84c3-a75870e08990 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.087797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.088402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.088685 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.088962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.089701 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.091597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.164788 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1415/2871] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:16.169056 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.179691 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d5542-2465-4eff-bcb0-6c90bb5cb286 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.237841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.238434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.238721 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.239001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.239685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.241615 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.333315 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1457/2872] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:16.337437 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.347664 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea530c-af89-4a4e-b2a8-29f01bddf796 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.352313 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.352962 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.353250 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.353523 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.354277 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.355892 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.366622 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1416/2873] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:16.370539 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.380975 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9d1e1-46a3-4900-8b85-6b17765c5f58 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.386164 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.386860 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.387151 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.387464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.388198 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.389825 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a6fe2-6862-4c3d-8719-090b4505e66a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.400366 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1458/2874] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:16.404302 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.414108 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7bb79-d1b0-490a-a5c9-58c1d38528e4 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.418668 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.419524 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.419800 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.420068 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] PATH_INFO: `/v3/projects/f31935457af34791a01e20c4188af10d/users/7e97cea19034466c82a3ed3875f8d5ef/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.434588 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31935457af34791a01e20c4188af10d, user_id=7e97cea19034466c82a3ed3875f8d5ef, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.437831 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.557989 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1417/2875] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:16 2022] PUT /identity/v3/projects/f31935457af34791a01e20c4188af10d/users/7e97cea19034466c82a3ed3875f8d5ef/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:37:16.572801 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.573123 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.573408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.600428 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] MFA Rules not processed for user `7e97cea19034466c82a3ed3875f8d5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:16.601675 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:16.665294 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1459/2876] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:16.669958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.696953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:16.730598 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cdfd9-8656-45b5-9a0e-5d39ffe23f25 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.735948 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.736597 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.736881 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.737156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.737864 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.739753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:16.848415 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1418/2877] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:16.852369 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:16.863609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945297-b05c-4848-8a4e-06d325b72ab1 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:16.909513 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:16.918829 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:16.919637 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:16.919922 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:16.920200 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] PATH_INFO: `/v3/users` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:16.920876 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:16.923547 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.012340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1460/2878] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:16 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:17.016994 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.027641 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b528b-3c89-4acd-9c7e-2bb71c74db02 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.032943 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.033780 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.039594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.039594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.039594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.039594 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.047647 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1419/2879] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:17.051742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.061520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984a64-ffc2-440f-badd-cbd1ca653486 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.066271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.067138 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.067420 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.067696 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] PATH_INFO: `/v3/projects/b4d0834550454ae59d557c3d6cc8a29e/users/636cede5ff9144a6badfb06402a4f187/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.082701 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d0834550454ae59d557c3d6cc8a29e, user_id=636cede5ff9144a6badfb06402a4f187, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.085321 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.161609 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1461/2880] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:17 2022] PUT /identity/v3/projects/b4d0834550454ae59d557c3d6cc8a29e/users/636cede5ff9144a6badfb06402a4f187/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:17.165449 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.175320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc5da-79ff-4dc1-af7b-1bff3771805d admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.231398 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.232070 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.232359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.232642 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.233378 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.235300 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa0ae3-5e80-4015-bd60-12a901d1fd51 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.245607 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1420/2881] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:17.249841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.260568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8adf2f-8549-4ace-b9ec-0230c36aab37 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.266071 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.266986 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.267266 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.267541 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] PATH_INFO: `/v3/projects/b4d0834550454ae59d557c3d6cc8a29e/users/636cede5ff9144a6badfb06402a4f187/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.269915 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d0834550454ae59d557c3d6cc8a29e, user_id=636cede5ff9144a6badfb06402a4f187, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.272549 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.283795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1462/2882] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:17 2022] PUT /identity/v3/projects/b4d0834550454ae59d557c3d6cc8a29e/users/636cede5ff9144a6badfb06402a4f187/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:17.294006 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.294299 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.294578 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.321216 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] MFA Rules not processed for user `636cede5ff9144a6badfb06402a4f187`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:17.322470 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:17.388978 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1421/2883] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:17.401345 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.403271 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:17.463044 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33a374-f26f-4909-bbaf-37a9db30323a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.466699 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.467349 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.467641 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.467923 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.477849 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.479288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d510a-5a59-4b45-a45c-4bea4ca1cfea service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.489598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1463/2884] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:17.554261 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:17.575426 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:17.632320 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163df19-5cdf-4b36-a753-6954eabd1981 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:17.637965 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:17.638928 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.639210 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.639487 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] PATH_INFO: `/v3/users/7e97cea19034466c82a3ed3875f8d5ef` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.640938 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e97cea19034466c82a3ed3875f8d5ef)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:17.643013 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:17.857303 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e97cea19034466c82a3ed3875f8d5ef'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:17.858057 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e97cea19034466c82a3ed3875f8d5ef'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:17.858592 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e97cea19034466c82a3ed3875f8d5ef'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:17.865638 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e97cea19034466c82a3ed3875f8d5ef'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:17.945941 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e97cea19034466c82a3ed3875f8d5ef'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:17.963665 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1422/2885] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:17 2022] DELETE /identity/v3/users/7e97cea19034466c82a3ed3875f8d5ef => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:17.968145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:17.969184 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:17.969491 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:17.987185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:17.988398 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:18.045567 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1464/2886] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:18.055156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:18.056636 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:18.113127 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0236c-561c-44a8-9bfd-12546f18e566 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:18.116616 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:18.117281 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:18.117589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:18.117865 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:18.127385 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:18.128810 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:18.138193 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1423/2887] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:18.533946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:18.535404 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:18.548519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ceeb0-cdbf-4820-a0fd-2bf611562968 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:18.553216 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:18.554128 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:18.554413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:18.554693 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] PATH_INFO: `/v3/projects/f31935457af34791a01e20c4188af10d` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:18.555920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31935457af34791a01e20c4188af10d)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:18.557954 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:18.649651 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:18.655997 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31935457af34791a01e20c4188af10d', 'request_id': 'req-61e5e87f-637c-4306-a8e2-6cf257c47ee9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:18.661470 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31935457af34791a01e20c4188af10d', 'request_id': 'req-61e5e87f-637c-4306-a8e2-6cf257c47ee9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:18.735508 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31935457af34791a01e20c4188af10d', 'request_id': 'req-61e5e87f-637c-4306-a8e2-6cf257c47ee9'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:18.747034 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] The token cache is being invalidate because project f31935457af34791a01e20c4188af10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:18.750183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:18.750183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:18.750758 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1465/2888] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:18 2022] DELETE /identity/v3/projects/f31935457af34791a01e20c4188af10d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:18.754710 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:18.764244 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a384714-d396-4d51-8e32-449f6dfc64f1 service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:18.803802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:18.819992 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:18.820870 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:18.821156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:18.821434 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] PATH_INFO: `/v3/users/636cede5ff9144a6badfb06402a4f187` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:18.822715 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636cede5ff9144a6badfb06402a4f187)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:18.824628 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:19.022980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636cede5ff9144a6badfb06402a4f187'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.023626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636cede5ff9144a6badfb06402a4f187'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.024144 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636cede5ff9144a6badfb06402a4f187'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.031644 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636cede5ff9144a6badfb06402a4f187'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.117972 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-dc6fe639-51ac-4b2e-a0c0-ee16a8b23243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636cede5ff9144a6badfb06402a4f187'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.135459 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1424/2889] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:18 2022] DELETE /identity/v3/users/636cede5ff9144a6badfb06402a4f187 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:19.585940 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:19.587453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:19.602850 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5e87f-637c-4306-a8e2-6cf257c47ee9 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:19.661974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:19.662841 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:19.663126 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:19.663402 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] PATH_INFO: `/v3/projects/b4d0834550454ae59d557c3d6cc8a29e` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:19.664626 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d0834550454ae59d557c3d6cc8a29e)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:19.666583 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:19.776127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d0834550454ae59d557c3d6cc8a29e', 'request_id': 'req-4f3785c6-339d-44f1-bdaa-634878276449'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.781941 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d0834550454ae59d557c3d6cc8a29e', 'request_id': 'req-4f3785c6-339d-44f1-bdaa-634878276449'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.846836 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d0834550454ae59d557c3d6cc8a29e', 'request_id': 'req-4f3785c6-339d-44f1-bdaa-634878276449'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.858650 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] The token cache is being invalidate because project b4d0834550454ae59d557c3d6cc8a29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:19.858974 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.859608 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-4f3785c6-339d-44f1-bdaa-634878276449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:19.861130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1466/2890] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:19 2022] DELETE /identity/v3/projects/b4d0834550454ae59d557c3d6cc8a29e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:19.866039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:19.866354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:19.866626 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:19.884949 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:19.886170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:19.945208 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1425/2891] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:20.005375 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.005757 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.006046 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.024687 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:20.025936 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:20.034001 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1467/2892] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:20.038087 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.048369 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5093674-5283-4876-86c4-bb13f67cc730 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.052791 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.053436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.053750 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.054024 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.054736 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 09:37:20.055039 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.056618 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.068476 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1426/2893] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 21 09:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 09:37:20.072729 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.082042 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041059-9d7f-4c5b-904c-83156c4d9a87 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.086613 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.087236 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.087518 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.087795 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.088466 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.090381 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.174468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1468/2894] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 09:37:20.178417 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.189446 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b511-7f79-415a-8b88-daf098aff917 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.233136 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:20.245540 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.246232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.246518 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.246797 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.247479 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.249475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.341259 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1427/2895] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:20.351193 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.362594 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ef092-1883-4fdb-a201-6702e9a72848 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.367344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.367998 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.368284 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.368560 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.369288 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.370969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.381579 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1469/2896] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:20.385419 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.397094 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93ed6-ba40-4984-8e42-8ccadadd9efb admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.402333 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.402988 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.403274 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.403558 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.404284 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.406423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ce11-604c-4079-8c9b-0a6219dd9e46 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.416926 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1428/2897] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:20.420874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.431501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec058fc-2182-40d1-ad06-b0b8687f7c9a admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.436003 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.436945 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.437241 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.437620 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] PATH_INFO: `/v3/projects/6dd5c6f80e00432a9845d40fb907f4cd/users/8269faede6ff4a8691fece7cc03a33fb/roles/b2a89d6203584406a6a215144e4dee65` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.451815 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd5c6f80e00432a9845d40fb907f4cd, user_id=8269faede6ff4a8691fece7cc03a33fb, role_id=b2a89d6203584406a6a215144e4dee65)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.454526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.457522 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:20.589352 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1470/2898] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:20 2022] PUT /identity/v3/projects/6dd5c6f80e00432a9845d40fb907f4cd/users/8269faede6ff4a8691fece7cc03a33fb/roles/b2a89d6203584406a6a215144e4dee65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:20.600423 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.600719 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.601000 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.627329 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] MFA Rules not processed for user `8269faede6ff4a8691fece7cc03a33fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:20.628589 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:20.695240 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1429/2899] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:20.699568 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.763483 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018478e-0647-4dde-903c-c64216ccad6c admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.769157 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.769863 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.770152 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.770434 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.771127 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.773047 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:20.899431 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1471/2900] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:20.903539 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:20.915226 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44880a8e-95bb-47b2-8ca9-d605517d85da None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:20.970749 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:20.971354 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:20.971640 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:20.971916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] PATH_INFO: `/v3/users` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:20.972604 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:20.974572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.038425 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1430/2901] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 21 09:37:20 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 09:37:21.042411 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.052797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e92c-68a6-43ea-b7e3-f268730f5a3d admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.057636 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.058448 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.058739 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.059022 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.059755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.061371 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.071948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1472/2902] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:21.075980 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.086447 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd70c-9bc6-4fbb-9004-530443b8c926 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.091030 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.091908 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.092196 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.092475 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] PATH_INFO: `/v3/projects/4895d17fa3a64066a59d7026150a9502/users/eb79fb9dcfd04807a3be875217404166/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.108923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4895d17fa3a64066a59d7026150a9502, user_id=eb79fb9dcfd04807a3be875217404166, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.111753 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.180436 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1431/2903] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:21 2022] PUT /identity/v3/projects/4895d17fa3a64066a59d7026150a9502/users/eb79fb9dcfd04807a3be875217404166/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:21.184485 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.196145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598fae-26a5-4c61-8121-5636e59f3e65 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.252544 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.253130 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.253413 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.253733 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.254460 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.256041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6ba6-4aac-45e7-a08c-3a2acdabcdd8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.266117 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1473/2904] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 21 09:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 09:37:21.270549 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.280671 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2bfe-36c7-49a5-b14c-dfada7f2edc9 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.285202 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.286119 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.286399 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.286670 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] PATH_INFO: `/v3/projects/4895d17fa3a64066a59d7026150a9502/users/eb79fb9dcfd04807a3be875217404166/roles/77bc6cd663c445d4b3a025be54e86d14` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.288608 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4895d17fa3a64066a59d7026150a9502, user_id=eb79fb9dcfd04807a3be875217404166, role_id=77bc6cd663c445d4b3a025be54e86d14)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.291236 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.301851 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1432/2905] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 21 09:37:21 2022] PUT /identity/v3/projects/4895d17fa3a64066a59d7026150a9502/users/eb79fb9dcfd04807a3be875217404166/roles/77bc6cd663c445d4b3a025be54e86d14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:21.312317 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.312617 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.312893 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.340738 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] MFA Rules not processed for user `eb79fb9dcfd04807a3be875217404166`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:21.341978 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:21.391145 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:21.408700 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1474/2906] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:21.419916 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.421693 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:21.432430 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:21.479565 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64b3f-1d90-4d59-a8ee-d43844d8c72c admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.483347 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.485139 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.485468 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.485763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.495334 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.496742 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.506828 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1433/2907] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:21.626206 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:21.635934 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b999c-f54c-4cb8-8b33-041bb9111c7d None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:21.639777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca5883c2c74481f88f33e24fe230198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:21.640456 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:21.640742 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:21.641025 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:21.698344 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:21.699784 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073b3e-7e34-4e1c-bbdd-cab88d817455 service cinder] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:21.708809 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1475/2908] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:37:22.180544 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:22.243999 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59dd93-6c63-450e-bc28-874b9ea5e339 service cinder] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:22.248572 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:22.250080 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:22.250384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:22.250672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] PATH_INFO: `/v3/users/8269faede6ff4a8691fece7cc03a33fb` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:22.251882 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8269faede6ff4a8691fece7cc03a33fb)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:22.253826 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:22.426813 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8269faede6ff4a8691fece7cc03a33fb'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:22.427402 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8269faede6ff4a8691fece7cc03a33fb'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:22.428056 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8269faede6ff4a8691fece7cc03a33fb'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:22.434995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8269faede6ff4a8691fece7cc03a33fb'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:22.494672 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8269faede6ff4a8691fece7cc03a33fb'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:22.512545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1434/2909] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:22 2022] DELETE /identity/v3/users/8269faede6ff4a8691fece7cc03a33fb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:22.517172 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:22.517462 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:22.517777 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:22.535453 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.auth.core [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] MFA Rules not processed for user `296495a1ad1f4210a892e5227d3c8067`. Rule list: `[]` (Enabled: `True`). {{(pid=80463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:22.536664 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:22.594917 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1476/2910] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 21 09:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:22.604412 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:22.605958 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:22.640492 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:22.663382 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf85ec-e550-486d-ba81-f40db18d6ec8 admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:22.667083 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3575daa9fded4cfb9686c817753f246c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:22.667724 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:22.668007 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:22.668282 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:22.678384 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:22.679764 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:22.689462 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1435/2911] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:23.073340 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:23.074946 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:23.090989 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f43ce-e5c9-4399-a3c6-7d661b39d8a0 None None] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:23.097521 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:23.098476 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:23.098812 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:23.099106 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] PATH_INFO: `/v3/projects/6dd5c6f80e00432a9845d40fb907f4cd` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:23.100347 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd5c6f80e00432a9845d40fb907f4cd)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:23.102331 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:23.218246 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd5c6f80e00432a9845d40fb907f4cd', 'request_id': 'req-5583946f-efeb-4623-ad31-20afb1f7cfe2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.223907 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd5c6f80e00432a9845d40fb907f4cd', 'request_id': 'req-5583946f-efeb-4623-ad31-20afb1f7cfe2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.291908 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd5c6f80e00432a9845d40fb907f4cd', 'request_id': 'req-5583946f-efeb-4623-ad31-20afb1f7cfe2'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.304422 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] The token cache is being invalidate because project 6dd5c6f80e00432a9845d40fb907f4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:23.305249 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.305429 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.307053 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1477/2912] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:23 2022] DELETE /identity/v3/projects/6dd5c6f80e00432a9845d40fb907f4cd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:23.311002 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:23.321818 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431271da-a604-4095-869b-a1ed0e76839d service neutron] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:23.379076 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:23.379953 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:23.380232 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:23.380512 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] PATH_INFO: `/v3/users/eb79fb9dcfd04807a3be875217404166` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:23.381804 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb79fb9dcfd04807a3be875217404166)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:23.383617 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:23.574258 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb79fb9dcfd04807a3be875217404166'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.574919 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb79fb9dcfd04807a3be875217404166'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.575530 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb79fb9dcfd04807a3be875217404166'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.582499 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb79fb9dcfd04807a3be875217404166'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.643775 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1edee787-ee25-45e2-a0b7-e9a828b20146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb79fb9dcfd04807a3be875217404166'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:23.662359 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1436/2913] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:23 2022] DELETE /identity/v3/users/eb79fb9dcfd04807a3be875217404166 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:24.073885 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:24.075355 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:24.090118 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583946f-efeb-4623-ad31-20afb1f7cfe2 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:24.100169 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:24.148319 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:24.149183 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:24.149464 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:24.149767 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] PATH_INFO: `/v3/projects/4895d17fa3a64066a59d7026150a9502` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:24.151050 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4895d17fa3a64066a59d7026150a9502)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:24.152948 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:24.270831 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4895d17fa3a64066a59d7026150a9502', 'request_id': 'req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:24.276408 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4895d17fa3a64066a59d7026150a9502', 'request_id': 'req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:24.349959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4895d17fa3a64066a59d7026150a9502', 'request_id': 'req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:24.362500 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] The token cache is being invalidate because project 4895d17fa3a64066a59d7026150a9502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:24.362905 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:24.371041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:24.371041 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1478/2914] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:24 2022] DELETE /identity/v3/projects/4895d17fa3a64066a59d7026150a9502 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 09:37:33.658802 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:34.361574 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:37.806925 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] REQUEST_METHOD: `POST` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:37.807442 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:37.807545 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:37.825669 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.auth.core [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] MFA Rules not processed for user `92ec739cd04543e4b75886c851ef9412`. Rule list: `[]` (Enabled: `True`). {{(pid=80464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:37:37.826867 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:37.881993 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1437/2915] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 21 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:37:38.050663 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:38.052078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:38.121707 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee2b4-b60a-4f9a-a37d-d9bc40a13fe8 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:38.126827 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3e7115f88940f18234bab2425977ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:38.127468 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:38.127755 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:38.128032 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:38.136101 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:38.137722 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:38.146658 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1479/2916] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 21 09:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 09:37:42.626346 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:42.628439 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:42.697746 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3715-837d-4d4f-81f9-91dd09d79db6 None None] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:42.702747 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:42.703457 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] REQUEST_METHOD: `GET` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:42.703706 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:42.703986 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:42.705995 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:42.717676 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:42.719368 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:42.729408 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1438/2917] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:37:46.225705 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:46.227212 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:46.293067 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b09e-7d59-4ffd-a277-3d2f7f501b93 service swift] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:46.297797 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:46.298679 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:46.298969 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:46.299250 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] PATH_INFO: `/v3/users/bed028a55ff84550a30374a6baca43e5` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:46.300488 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed028a55ff84550a30374a6baca43e5)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:46.302501 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:46.505382 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed028a55ff84550a30374a6baca43e5'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:46.518228 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed028a55ff84550a30374a6baca43e5'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:46.518891 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed028a55ff84550a30374a6baca43e5'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:46.519519 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed028a55ff84550a30374a6baca43e5'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:46.526378 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed028a55ff84550a30374a6baca43e5'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:46.608642 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1480/2918] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:46 2022] DELETE /identity/v3/users/bed028a55ff84550a30374a6baca43e5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:46.845272 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:46.857833 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cf3e1-abf8-4f8c-a907-c7f132079554 service placement] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:46.915307 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:46.916170 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:46.916455 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:46.916732 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] PATH_INFO: `/v3/projects/b1ea043a23b6470096dc7c7e74ea4247` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:46.917944 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ea043a23b6470096dc7c7e74ea4247)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:46.919840 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:47.009923 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:47.018763 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ea043a23b6470096dc7c7e74ea4247', 'request_id': 'req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.123064 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ea043a23b6470096dc7c7e74ea4247', 'request_id': 'req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.128955 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ea043a23b6470096dc7c7e74ea4247', 'request_id': 'req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.140109 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] The token cache is being invalidate because project b1ea043a23b6470096dc7c7e74ea4247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:47.140395 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.141689 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.143551 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1439/2919] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:46 2022] DELETE /identity/v3/projects/b1ea043a23b6470096dc7c7e74ea4247 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:47.147677 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:47.149814 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:47.162920 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa78ce-e20d-4972-b63a-958e88785e81 admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:47.167542 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:47.218909 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:47.220409 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:47.220685 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:47.220959 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] PATH_INFO: `/v3/users/245edd6798e24fe5a883c35bcfede800` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:47.222185 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=245edd6798e24fe5a883c35bcfede800)` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:47.224109 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:47.437143 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245edd6798e24fe5a883c35bcfede800'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.449526 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245edd6798e24fe5a883c35bcfede800'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.450245 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245edd6798e24fe5a883c35bcfede800'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.454320 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245edd6798e24fe5a883c35bcfede800'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.458447 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.notifications [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245edd6798e24fe5a883c35bcfede800'} {{(pid=80463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:47.530379 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1481/2920] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 21 09:37:47 2022] DELETE /identity/v3/users/245edd6798e24fe5a883c35bcfede800 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:47.771610 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Authenticating user token {{(pid=80464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:37:47.773032 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.fernet_utils [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:37:47.787206 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698ac5-5f52-45bd-84ee-dfd62eec7c6b admin admin] Validating token access rules against request {{(pid=80464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:37:47.843674 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296495a1ad1f4210a892e5227d3c8067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e449c5adf9473b93e84773b7f3aad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:37:47.845286 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:37:47.845871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:37:47.845871 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] PATH_INFO: `/v3/projects/756b109db7f54e27be2572b6cac76833` {{(pid=80464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:37:47.847063 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756b109db7f54e27be2572b6cac76833)` {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:37:47.848973 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] RBAC: Authorization granted {{(pid=80464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:37:47.959695 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756b109db7f54e27be2572b6cac76833', 'request_id': 'req-590ae728-a7bb-41a5-b8fd-e84b3b071834'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:48.008773 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756b109db7f54e27be2572b6cac76833', 'request_id': 'req-590ae728-a7bb-41a5-b8fd-e84b3b071834'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:48.015443 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756b109db7f54e27be2572b6cac76833', 'request_id': 'req-590ae728-a7bb-41a5-b8fd-e84b3b071834'} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:48.027237 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] The token cache is being invalidate because project 756b109db7f54e27be2572b6cac76833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:37:48.027548 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:48.028181 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG keystone.notifications [None req-590ae728-a7bb-41a5-b8fd-e84b3b071834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:37:48.029839 dv-cinder-826608-6-smb devstack@keystone.service[80464]: [pid: 80464|app: 0|req: 1440/2921] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 21 09:37:47 2022] DELETE /identity/v3/projects/756b109db7f54e27be2572b6cac76833 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:37:57.526726 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:37:58.024156 dv-cinder-826608-6-smb devstack@keystone.service[80464]: DEBUG dbcounter [-] [80464] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:41:43.570990 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Authenticating user token {{(pid=80463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:41:43.572377 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:41:43.708894 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf177c-8deb-4926-a172-64f51da4a94f admin admin] Validating token access rules against request {{(pid=80463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:41:43.766867 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb8ce5739dd4a8db6e0f9d2449edfe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2524486423e4706a60817d9acb25381', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:41:43.767520 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] REQUEST_METHOD: `GET` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:41:43.767803 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:41:43.768078 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:41:43.769874 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.fernet_utils [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:41:43.780924 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:41:43.782598 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1262-ce67-4284-a5bf-683529bc23c3 service placement] RBAC: Authorization granted {{(pid=80463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:41:43.793036 dv-cinder-826608-6-smb devstack@keystone.service[80463]: [pid: 80463|app: 0|req: 1482/2922] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 21 09:41:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:41:53.788808 dv-cinder-826608-6-smb devstack@keystone.service[80463]: DEBUG dbcounter [-] [80463] Writing DB stats keystone:SELECT=89 {{(pid=80463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}